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ABSTRACT / x . 

The Language Prof iciency^ Assessment (LPA) Symposium 
was held to integrate the insights gained from findings emerging from 
the research component and the implementation ot the teacher training 
programs of the Assessment of Language Proficiency of Bilingual - 
Persons (ALPBP) project. This final report on the symposium consists 
of three component reports. The first, "Issues in th6 Assessment of 
Language Proficiency of Language Minority Students," by C. Rivera and 
C. Simich, is an analysis of the literature and research in the area 
of language prof ic iency*" assessment , The second article is a summary 
of symposium presentations. These two reports provide documentation 
regarding the state of the art of language proficiency assessment and 
summarize research issues which need to be further documented'. The 
third component report is a proposed plan for public dissemination of 
the symposium proceedings. (Author/AMH) 
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The LangOage Prof i ciency 'AssessTnentVlPA) Symposium 

. - '1 . ■ '■ : 

The Language Proficiency Assessment (LPA) Symposium, held March \k l8,j 
1981, at Airlie House in Warrenton, Virginia was planned and implemented 
part of the ALPBP project. The LPA S'ympos i um represented a .major effort 
toward integrating both the i ns i ghts ,ga i ned. f rom findings emerging from the 
research component and the Mmpl ementation of the teacher training programs of 
the' ALPBP project. The Symposium provided a forum where a broad spectrum of 
reisearchers , practitioners, and policymakers met to discuss th,e major issues 
and research findings which affect language proficiency assessment practices. . 
The Symposium al so ' provi ded a structure for participants to make practical 
recommendations directed at influencing federal and state policies regarding 
language proficiency assessment research and practices. Another objective of 
the Symposium was to encourage the participants to develop a network of com^ 
mynication foi^ the purposes of exchanging information and incorporating this ' 
knowledge into. their areas of responsibility. ' °' 

Researchers were represented by scholars involved in the development of 
models of communicative competence, related empirical research , /and the devel- 
opment and validation of tests of language proficiency and/or communicative 
competence. Practitioners' included teachers and school administrators engaged 
in the implementation of programs which require the appl i cat ion of language 
proficiency assessment strategies. Policymakers were individuals who play an 
important role in the funding of educational research projects related to ; 
language proficiency assessment and who are Influential in the .establ ishment 
of policy in this area. ' ' . 

• I 
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The participants interacted through the presentat i on' of papers, reactions 
to presentations, and informal discussions'. The main goals of the Symposium 
were selected by the organizers based on a survey of concerns of researchers 
and educator^r. The goals weref - . ^ . " v^'''*^' 

o- to develop a working definition of communicative competence/ ^ 
language proficiency; . ' 

o to make recommendations for the assessmefrit of language 
minority students for the purpose of entry/exit into 
appropriate educational programs; and 

o to develop an agenda for future research based , on present 

and past research. " ' , 

r » . 

^ The issues in the area of language proficiency assessment ranged from 
theoretical questions regarding the nat;,ure of communicative competence- to 
the application of research findings. Central to the discussion of language 
proficiency assessment was the acknowledged need to clarify^ tfie nature and 
scope' of cdfnmunicative competence 'and its relationship to language proficiency. 
Topics of discussion 1n this regard i ncl uded. research findings ooncerning the 
nature of children's language use and the role of f^rst and second language 
in the learning of literacy-related skills. - 

Language teS^t-s and test i ng* methods were also topics addressed by the 
parti'cipants. Qu'estions were raised as to what these tests, should be measuring 
and why. Many of the participants were concerned with the issue of reliability 
of currently-used language proficiency assessment j nstruments ^ as wel^l as with 
the development of new, more appropr iate measures . A ^mul tVdIscipl inary 
approach to language proficiency assessment and the development of more • 
rnnovative methods of language testing was supported by participants. An 
approach of this type would ut i 1 i ze "i nformati on from such areas as psychology, 



anthropology, and linguistics, chus providing thi§^ opportun i ty to. gain i-nsights 
.from, different perspectives into patterns o^ language use and related topics. 
A sQCiol inguis tvic/ethnographic perspective to language proficiency assessment;, 
for i2fxan3ple, was one of .the unique approaches which was examined at the 
Sympos i.unr. . . 1 

The 'impl ications of new research findings on the establishment of govern- 
ment policy, and In particular, of federaF guidelines In the area of language 
proficiency assessment, was a tppic -which most of the part ici pant%. bel iev^ ' 
required serious -CQps iderat ion . Since 1 anjuage' prpf i ci ency assessment prac- 
tices are currently undergoing a period of^change anci reevaluation, it w.as 
suggesteci that th^ federal government, . Tn revisTng th'e LAU guidelines, provide 
a me^s of incorporating new research findings regarding the nature of language 
,whi.ch have implications for 'assess i ng mino'rity students. 

( ' . ■• . . ■ ■ " 

The IPA Symposium report consists of three component reports. The first* 
is an analys.is of the literature and research in the area of language profi- 
ciency assessment "^and is found, in the article: issues in the Assessment of 
Language Proficiency of Language. Hi nori ty Students, by Charlene Rivera and 
Qarmen Simich. The second is a summary o^ symposium presentat Tons . These 
two reports provide important documentation regarding the state of the art 
of language* proficiency assessment. In addition, they summarize research 
iissues vyhich need to be further documented. r The third component - report is a 
publication dissemination plan for the symposi'um proceedings v'/hich are to be 
published through the Center for Appl ied- LInguisti'cs. I 



Issues, in the Assessment of Language Proficiency " . ^ 
• . of Language 'Minori ty Students " ^ 

t 

Charlene Rivera ' ^ Carmen Simich 

InterAmerica Research Associates ' Georgetown University 

Rosslyn, VA • • ' . Washington, D.C. 



-Passage of the Bilingual Educat iorr Act in 1968, the upholding 
of the Lau vs. -Nichols decision in 197^, and the'^sltbsequent '.'Remedies" 
Task Force of 1975 have focused attention on the identification of 
language minority students based on their English language proficiency. 
The legal assumption, 'as seen through the Remedies, is that it is . 
possible to measure language minor i ty .^students ' language prof ic.ieo'cy 
and, based on this assessment, to make recommendations' for^their' 
placement in monolingual, €ngli.sh as a Second Language (ESL) and/or 
Bilingual Education programs. 

.Theoretically, this approach .appea rs reasonable. In application, 
however, the Lau* mandate has proven diffJc^i^t to implement. While 
it is generally acknowledged that a pers/n ' s -prof i ci ency in a language 
.falls along a continuum from 'non-speaker , to proficient speaker of a • ^ 
language, research has not pY^ided evidence which would al low-valid 
and rel ialj'lje weighting of language skills as indicators of different 
levels of language prof iciency. ^ Educators have general ly .rel ied on 
available language proficiency measures in search for viable alter- 
natives for as^es-sing language proficiency. However, avail^^ble 
instruments^ in general have not proven to be psychomet r i ca 1 1 y or 
Ifnguistical ly rel tattle and 'valid (Rosansky, 1981)-. Hany of the 



'instruments most ccmmonly used in. bilingual programs| when administered to the. 
same students , place them at varying levels of proficiency (Gillmore 
S Oickerson, 1979; Cili*barri, Spencer 5 Rivas, I98O). Moreover, the^ 
constructs of language being measured are not necessari^ly compa.tible 
(Rodriguez-Brown, 1981} . . - ' » - 

* « 
The issues of language assessment and placement raise several 

important questions which are the focus , of this article. 

• What are the basic premises upon whTch current 
language assessment instruments hds/e been developed? ' 

• What is the state of the, art "hn language proficiency 
assessment? 

• What imp 1 i cat ions do cur rent r;esearch find ings have 
for 1-anguage proficiency assessment?, 

.... ^ • ' N 

What are the 3as-lc Premises Upon Whiph Current Language Asgtssment 
Instruments Have Been Developed? 

-Directions in the development of assessment measures have been 
greatly influenced by developments in psychology an^d linguistics. 
Thus, in respond i ng" to the issue of basic premi ses' 'upon which current 
language proficiency measures are based, it is necessary to review 
salient contributions from these ».d i sc i p I i nes . 

The behavior! St ic coqceptua f i zat ions of learning as evidenced 
^in structural linguistic theory (Bloomfield, 1933) was a major force 
in. l^ngu^^e testing in the mid 1300's. From a behaviorist perspective 
structuralists came to view language as a set of conditioned responses 



to, external stimuli.: They described language a^s consisting of several 
^ompofi^nts phonojogy, morphology, syntax and. the lexicon. The 
emphasis of JIngulstIc research was. to provide, a detailed descriotion • 
of th'ese components. . - . , •• . 

The influence of psy^^hometr ic" meth'odoloqy and structural' lingujstfc 

theory promoted a sc i en t i f i c'or i en ta t i on to the fneasurement of Iancuag*e 

proficiency. -Language assessment 5^ame to be viewed as an objectTve 

process >^hich mu'^t be reliable and va.l id CSpblsky, 1978). The common 

practice in devefoping language assessment measures was isolate 

and measure discrete language components. Lado'^s classic bock Language 

Testing:' The Construction and Use of Foreign Language Tests (.1 961) is 

• * 
an excellent example of this perspective. 

.An increased pressure to provide foreign language educatfon'to 
the mil.itary, a result of Wqrld War 1, prompted t»he development of 
foreign language methodology and teaching materials. * Soth were 
greatly influenced by structural ist/qehey iorist approaches. Oral 
language was considered primary and teaching a foreign language was 
based on repetition of drills and exercises where the learning of » 
discrete components of language was empTiasized. - 

Carroll (1952) was one of the first researchers to voice dissatisfaction 
with this approach. He suggested that language be considered more 
than the sum of its discrete parts, and that its measurement be regarded 
as an integrative process ,v/Ith an emphasis on the ''total communicative 



effect of an utterance". ^ These concepts ace basic to later develop- 
ments in psychol'inguistics and sociol Ingu is't ics 

A brief review of psycho 1 i ngu i s 1 1 c theory is essential to 
understand the rationale underlying the integrative or holistic 
testing trend. One interpretation of psycho 1 i ngu i s t i cs is based on 
Chomsky's (1^65) generative linguistic theory, which postulates that- 
a grammar .should .have descriptive, as well as explanatory adequacy; 
that I's , It sh«)Uld explain the mental processes underlying a speaker- 
hearer's ability to produce and understand his or her language. 

•Influenced by Chomsky's ideas, current psychol inguistic research 
has concentrated on two basic areas. One has fopused on explaining 
the mental processes a native speaker hses' to convert the deep 
structure of sentences, or the speaker-hearer's competence, into 
^surface structures in spoken J anguage , or the speaker-hearer's 
performance (Ingram, 1573).- The second area has focused on first 
5nd second language acqu^isition research (Ritchie, I978; McLaughlin, 
1978} which has been influenced !>y the belief that children are born 
with an innate knowledge of language universals (Chomsky, I965) . 

In recent y^^irs , Chomsky ' s ideas have been challenged by gener- 
ative lingu.ists who claim that the central component of language is 
semantic rather than syntactic. Focus of research In this area has 
been on the processes speakers-hearers use to perceive,' interpret, 
store Snd retrieve linguistic information when needed during communi- 
cation. ' ^ 

• - • ■ * . 

.10 



Other challenges to Chomsky's theories have been posed by 
pragmatists _C011er, I978, 1979), who claim that language cannot be' ' 
Studied as a self-contained system. Oiler def i n'^s pragmat i c facts 
of language as those aspects "having to do with the relations be- 
tween linguistic units, speakers and extral inguistic facts" (Oiler, 

1970, p. 99). In summary, psychol i ngui st i c research has been greatly 

» I, . ^ 

influenced by generative theory, and the need for a better under- 
standing of the manner"^ in which speakers -hea rers process language. ^ 

Several, attempts have been made to develop tests based, on ^ 
generative linguistic theory. One such attempt is represented by 
the Pims leur 'Language Aptitude Battery (Pims.leur, I966), Another 
IS represented by Bri^ere^s (1972) incorporation of a transformational 
subtest as part of a battery of tests developed' to measure the 
language proficiency of Native American children. In general, 
however, attempts'to apply t rans format i ona 1 -generat i ve theory to 
language teaching and testing-have not' been successful. Ingram 
(1978) indicates that th i s s i tuat ibn may be due to the fact that 
educators have not found, and researchers , have not offered, practi- 
cal. appl icat ions which are relevant and meaningful in Instructional 
settings. , • 

The influence of pragmatics on language proficiency testing is 
.^evidenced jn the wFdespread us of cloze and dictation tests (e.g.,' 
• Oiler, 1979; Oiler o Hinofotis, 198O; Wilson, I98O). Both are based on 
an integrative^ approach to measuring langgage proficiency. 
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Sdciol inguistic research highlights the difficulty cf measuring 
language via d i screte quan t i f i ab 1 e means. ^> Shuy points out that the 
most critical aspee'ts of language "a^e th^ ones least susceptible 
to'quantif ication'' (.1977, p. 77-78). In general, instruments oY. 
language- prof iciency measure easily quantifiable ct:mponents of 
language such as pronunc i a 1 1 on , vocabu 1 a ry , and grammar rather than 

a . ^ . 

those less visible or quantifiable, such as meaning'or the functional 
intent of utterances. Use of discrete point language assessment 
instruments does not provide valid^and accurate information about 
how effectively students participate In i ns t ruQt iona I settings. 
Thus, ^he soc lo I ingu i s t i c approach promotes evaluation of the appro- 
'priate use of language in d i f feren f cpmmun i cat i ve s'tuations. fts 
contribution to the development of 1 anguage prof i c i ency assessment' 
instruments is based on a broader interpretation of language which 
includes the use of linguistic code(s) by participants ^n ways which 
a^e acceptab I e . to other members of a speech community. 

Studies in language ^^riation have expanded the idea of the linguistic 
repertoire of speech communities (Gumperz, 1372). Applied to language 
proficiency assessment, thTs concept supports the view that minority 
students V language pr*of iciency should not be measured against the 
"standard" dialect of a langu*age. Rather, a student's way of 
speaking should be considered adequate and appropriate in terms of 
the purposes It serves during communication. For example, ins,the 
southv/est. where large numbers of Hispanic students live, code-switching 



incidences are common. This manner of communicadorTN^ould be considered 
appropriate given its functional use within the community. 

If we take the position that students' language should not be 

\ 

measured against a standard dialect, then we need to ask: why 
measure language proficiency? 

"The measurement of language proficiency is necessary to provide 

teachers with an understanding of the language skills students have already 

acquired in the home environment. A comparison between home language 

skills and functional language demands in the classroom setting will 

♦ 

provide necessary information upon which to place students in appro- ^ 
priate educational programs. 

More recent soc io 1 i ngu i s t i c research relates functional lancuage 
use to language proficiency, Shyy defines functional language use 
as '*the underlying knowledge that allow^ people to make utterances 
in^order to accomplish goals and to understand the utterances of 
others in term's of their goals. It includes a knowledge of what 
kinds of goals language can accomplish (the functions of language), 
and of what are permissible utterances to accomplish each function 
(language strategies)'' (1977, p. 79). Several researchers in the 
last decade have investigated functional language use in school settings. 
The focus of their research has been on specific aspects of why and how 
tc-hildren use language in different social contexts (e,g.,Cahir, 1978: 
Cazden, 1979; Simich, I98O; Jacob, 198I). One outcome of the research 
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on functional language use In the classroom has been the development of 
several scciol ingul s tical ly based language assessment 'instruments. 

For example, Shuy, McCreedy and Adger (1979) developed an oral 
language assessment instrument for use with elementary school children 
who are speakers of vernacular Slack Eng 1 I sh '(VSE) . The instrument 
consists of three components. The first provides for approximate 
measurement of phonological and morphosyntact ic features. The ^ 
second component evaluates communicative competence according to 
relative appropr iateness and strategies children use for conversa- 
tional functions such as explaining, describing, etc. The third 
component evaluates discourse abilities, such as appropriateness 
of interrupting, use of transitional markers, referencing and style 
shifting. 

Another effort toward the development of soc lo 1 i ngu i s t i c/ 
ethnographic measures is represented in the work of Simlch and Rivera 
(1981) in cooperation with Sunnyside and Tucson Unified School 
Districts (TUSD) , in Arizona. An instrument, entitled the Teacher 
Observa t ion System (. TPS ) , was developed during a comprehensive 
two-year teacher training program. The goal of the program was to 
provide bilingual educators wjXh background in^ linguistics, socio- 
1 i ngu i s t i cs , ethnograph i c methodol ogles , measurement , and research 
methodologies in order to enable them to develop accurate and effective 
language proficiency assessment strategies. The TPS was developed 
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based on the understanding that the range of students' language 
repertoire can only be determined through systematic and focused 
observations of interactions in a varietY^o^^ school settings. A 
framework to identify the variables that influence students' 
communicative interactions was developed, based on certain compo- 
nents of speech events (Gumperz S Hymes^ 1S721. Th i s framework 
is described in Table !. 



TA3UC I 

ConipqnvnCS cT I n s C r uc c { ono 1 Cventj^ to. be Considered 
in ch« Ocve t oomen ( ,o f Ch« Teacher QbservJCion System 



Setting 



Part icipants 



/ longuaaesis) ^Used Discourse Characteristics 

of Cotnnunicat ion 7 * # 



Instruct ional 
( fornal ) 
vs. 

Mon- instruct iona I 
(informal) -vencs 



Teacher/Student (s) 
Student/Scudent (s) • 



speaking 
1 iscening 
reading 

_wr 1 1 1 ng 



Engl Ish 
Spanish 



coherence 
contple.x« ty 

adequacy of vocalJulary 
code-swl cching 



j The follow]^ questions helped participants focus on an ethno- 
graphic/ spciortngui Stic perspective during the deve I ppmen t of the 
TPS . 

• What kind of communicative skills do bilingual 
students need to master in order to participate 
appropriately as members of the soc iocu I tura I 
school environment? 

• In which soc iocu 1 tura I situations can these 
communicative skiHs be observedl*^- 

• What kinds of communicative skills do students 
bring to school? 

• in which ianguage(s), and soc iocu I tura I situations 
do' students have the widest contextual range of 
communicative abilities? » 
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The questions prompted a discussion of factors that i n f 1 uence^ s tuden ts ' 
communrcati ve fnteract Tons. The components consTdered were: classroom 
organization (teacher-centered vs. student-centered), language of 
Instruction, directness or indirectness of "teacher-talk": students' 
language use and their sociocul tural background; parents' socioeconomic 
and educational background, number of siblings, and language use at 
home, school and community. 

Through the process of developing the TPS , teachers became aware of the 
sociocul tural aspects of language as they*^ acquired more sensi ti vi ty and under 
standing of language use in multicultural/multilingual school settTngs. ThTs 
knowledge, they confirmed, assisted them in the classroom situation to 
make better judgements about their students* communicative proficiency. 

Slaughter and Bennett (198I) are attempting to develop a unified 
framework for the analysis of discourse samples elicited from Spanish/ 
English bilingual students. The f ramework w i 1 1 be used in the valid- 
ation of the Language Proficiency Measure ( LPM ) . The instrument developed 
by the TUSD purports to measure the language proficiency of K-12 English/ 
Spanish bilingual students based on samples of discourse elicited in an 
experimental setting. 

Another important development in language proficiency assessment 
is the incorporation of ecological validity as a cons ideration in the 
development and validation of language proficiency instruments. 

1-10 



Bronfenbrenner defines ecologically val Id experiments as those which 
are 

...conducted In settings that occur in the culture or sub*" 
culture for other than research purposes, or might occur if 
social policies or practices were altered. Accordingly, In 
contrast to conventional experiments, In which setting, 
participants and ^afctlvlties are often unfamiliar and the 
experiment Is a one-time event of short duration, ecological 
expei'iments Involve places, social* roles and activities 
that are enduring and known to the participants b'ecause 
they occur in everyday life... , . 

(1976, pp. 

Cazden, et al 09791 describe several instruments which conform to 
this ecological orientation in the 1977 artfcle. Language Assessment : 
Where, What and How. 

In summary, current language proficiency instruments reflect 
changes in theoretical perspectives in psychology, linguistics, 
psychol Inguistics , and sociol Ingui st ics . During the 195d^s and 
early 1960's structuralism and psychometr Ics influenced the develop- 
ment of language tests which were intended to be objective and reli- 
able. Later, developments in pragmatics and psyctio 1 1 ngu i s 1 1 cs led 
to wide use of cloze and dictation tests, reflecting the belief that 
language should be measured via holistic means. ^A new direction. of 
language proficiency testing is emerging as a result' of socfol inguistic/ 
ethnographic research. This latest trend promotes the measurement 
of language as it is used and negotiated by participants in natural 
settings. v • 




What is th e State of the Art in Language Proficiency Assessment' 

^ ^ " '■ ~ • 

Political recogfiitlon of bi 1 ingual. education came as a result of 

the- January -1568 passage of "the B i 1 in'gua 1 ^Educat iori . Act . Its passage' 
provided for the creation and federal support of b ! li ngua leduca t ion 
p^rograms for limited and non-English-Speaking students. The Bilingual 
Education, Act of 1 968 and the revised Act of 1 97^ 'def i ne bilingual 
education as a program of instruction that "is designed to teach .. . 
children in English and to te^ch in (the native) language so that 
they can progress " effect fvel y through school" (Bilingual Education: 
An Unmet Need, p. i). ^ " 

Language was found to be particularly significant in Che education 
•of language minority students in the 1974 Lau vs. Nichols decision. In 
complying with the opinion of the court, the San Francisco Unified School 
District, along with a-citizens' task force, developed the Lau Remedies 
(Task Force, 1975) as gu idel ines -for school districts to follow in the 
placement of students whose "home language is other than English*', 
£ongress codified qhe decision as part of the Equal Education Opportunity 
Act of 197^ (Teitlebaum S Hi Her, 19^77tV^ The ^jsmedies specify that the 
students be identified through a home language survey and be categorized 



as : 



A. MonoIingua»l speakers of the language other than English 

B. Predominantly speaks the 1 anguage other than English 



1-12 

. Id 



C . Bill ngua 1 . . 

D. Predominantly speaks English 

E. Monolingual speaker of English 

(Task Force, 1975, p.2) 
Students are to be placed in appropriate educational programs accord- 
ing to how they are categorized. 

The 1978 Education Amendments indicate that students who are 
eligible for bilingual education are no longer- defined as being L^SA 
or of "1 imi^ted English speaking cbility" but, rather, as beiqg LEP or 
of '''I imi ted^ Eng 1 i sh proficiency" (p. 69). The revised regulations 

specifically state that both oracy and literacy skills must be con- 

(J 

sidered, thus . refocus r ng the previous emphasis on oral proficiency. 
In other words, language proficiency, according to the amendments , 
includes all language t^ski lis, i.e., listening, speaking, reading and writing. 

. In the recently revised Lau regulations (Nondiscrimination, 1980) ,^ 
there was an attempt to recognize this orientation. Thus, ft was recom- 
mended that potentially eligible students be assessed in readig^ 
comprehension as well ^s. in oral proficiency'. Based on this assess- 
ment students were to be categorized as: ^ - 

# primary 1 anguage-supe r 1 or ; 

• comparably limited in both languages; or * 

\ • EnglTsh superior; ' ... 

(Nondiscriininac ion, 1980', p. 52055) 
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Although the rev i sed regu I a t f ons are presently defunct, and th*3 original 
Lau Remedies continue to be law, the revised regulations actually re- 
fleet a broader understanding of what is meant by 'language proficiency 
assessment. The inclusion of literacy as a^criteria for placement 
implies a recogniti-on of the interrelationship of oracy and literacy c 
skills. . \ 

We ask oursel ves, then, what Fs. the state of the art in thd dev'el- 
opment of language proficiency assessment Tnstruments? The l^egal 
mandate to comply with local and ^-federal regulations has all too 
often moved school districts to adopt, language assessment procedures- 
wh,ich ^re not necessarily valid or appropriate. Thus, -a school dis^' 
trict^s purpose for utilizing .certain procedure(s) and/or selecting 
language prof icfency instrument Cs). may not be motivated by edCicational 
concerns but by legal cons i derat i ons ^ In some cases, I.n an attempt to 
comply, school districts dissatisfied with available procedures and 
instruments ^have attempted to develop procedures which meet the local 
needs COrtiz, I98I ) . 

# 

From an educational pe^r spect i ve , the assessment of language 

proficiency is limited by'the availability of valid and appropriate 

instruments designed for this purpose. Clark (.1930) indicates that: 

As a largely Inexact science (at least at the present state of 
development of the discipl ine) , foreign - and second language 
proficiency testing does -not enjoy the detailed logical. and 
theoretical frameworks within which research and development 
activities take place in the 'hard' sciences. 

^ ' _ (p. 16) 
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A review of documents ^v?hich attempt -to systematically catalogue 
instruments indicates that criterion used to evaluate language assess- 
ment measures var^y greatly (Center f'or Study in Evaluation, CSE, Hoepfnei*, 
et al , 197^; Northwest Regional Laborator/^NWRL, Silverman, Noa S Russel, 1977; 
Bay Area Bilingual Education League, BABEL, Bye, 1978;' the Texas Report 
of the Committee for /the Evaluation of Language Assessment Instruments, 
1979, Boston Universi ty Bi 1 ingual Resource Training Center, BUBRTC, 
Rivera S Freytes, 1979, among others). For^^example," BABEL (Bye, 1978) 
describes cost, grade level, language of the test, what is measured, 
how the scores, are i nterpretabl^e , and whether the test has been field ^ 
tested. T|ie CSE (Hoepfner, 197^) and NWRL (Silverman, Noa S Russel , ,1977) 
report*5^.cg|ns I der measurement validity, examinee appropriateness, technical 



excein ence^ and administrative usability. In general, when technical 
psychometric criteria are consider^, the. majority of language assess- 
ment tests fall short. 

I 

In addition to psychometric considerations, there \$ Inconsistency 
in the manner In wh I ch 'd I f f eren t Instruments rate the same student's 
skills.. A study undertaken for the California State Department of 
Education (Ullbarri, Spencer S RIvas, I98O). found that a comparison 
of three oral language rneasures administered to the same students 
did not place them In parallel classifications;, that Is, students' 
"language abilities varied significantly across^ tes ts . The measures 
reviewe^d were the LAS ( Languafge Assessment Scales , Oe Avila S Duncan/ 
1976, 1977). the BSM ( Bilingual Syntax Measure , Surt, Oulay S 
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Hernande'z-Chavez, 1975), and the 8INL ( Basic Inventory of Natural ' 
Language , flerbert, 1977). 

* « 

GHlmore and Olckerson's (1979) analysis for the Texas Education 
Agency of the 3 iN L (Herbert-, 1977), the BSM_ (Burt, Oulay S Hernandez- 
Chavez, 1975), the LAS (Oe Ayila S Duncan-, 1976, 1977), the PAL Oral 

^ — 

Language Proficiency Measure (1978) , and the SPL IT ( Shutt Primary 

Language tncdicator Test (Shutt, 1976) indicates that while all the tests 
purport to be measuring the -same construct, the theoretical base for 
each is different. In general it was found that: 

' J . 

there is only a slight .to moderate relationship in the way 
any two of these tests are measuring language ability... 
The scores of stu4fnts with three assessments were summar- 
ized according to agreement of LESA (Limited English Speak- 
ing Ability) classifications. Of the students with three 
language assessment scores... 32% had three agreeifig LESA 
classif icat ioVis and. ..68% had disagreeing LESA classifica- 
tions" 
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Rodr iguez-3F^wn and El ias-01 i vares (l98l) examined^the language' 
constructs measured by three- popul ar language proficiency instruments- 
the James Language Domi-nance Test (James, 197^), the BSM (Burt, Dulay 
S Hernandez-Chavez, 1975), and the LAS (De Avila S Duncan, 1976^, 1977). 
A comparison of test items with language used by ch-ildren in natural 
settings revealed a discrepancy betv/een the language skills b^ing 

tested and children's actual linguistic repertoires. 

"\ ' 

Despite great d i ssat i s fact Ton with available language proficiency 
tests, the consensus has been that available instruments must be used. 




The Texas Report of the Committee for the Evaluation of Language 

Assessment Instruments, (1979) justifies the practice because: 

no better measuring devices exTst-.-the state of .the art 
" of our understand Fng is partial or i ncomp 1 ete.. . , (.i't is 
necessar'yl*' to make a decTsion on the basTs v/hlch is not 
completely subjective and/,. (there is ^n urgentl need to 
allocate services and ' resources . . - 

Cpp.^-5) 

In summary, the .mot i vat i on for developing language proficiency 
instruments and assessment procedure's is prompted by the need to 
identify and place LEP students in appnppriate educational programs. 

The issue is compo.unded by the pressure placed on schooT districts 
to comply with local and f^ideral regulations. The state of the art 
in language testing is such that available instruments, in general, 

do not possess psychometric reliability and validity, yet educators 

continue to use available instruments because "no better measuring 

devices exist" (Texas, p. 5)- 

What Implications Do Current Research Findings Have for Language 
Proficiency Assessment ? 

Development of language prof iciency assessment instruments has 
been greatly influenced by the various Jriterpretat ions ''of linguistic 
theories and their application. Assessment^measures developed in the 
1950*s and 1960^s were greatly influenced by structural linguistic 
.views of language and psychometric methodology which promoted the 
testing of discrete aspects of language. These instruments wer^ 



1-17 



2j 



generally intended for adults learning a foreign language and as such 

._.t!Jririg the 1970's the influence'of psycholinguistics was reflected in 
the attempt to Incorporate generative linguistic theory into language pro- 
ficiency testing. The c6ncept that "Che reliable variance in a great variety 
of educational 'and psychological tests can be attributed to a single global 
factor of language proficiency" (Oiler, 1979, p. 6l) motivated the development ^ 
of tests which "must invoke the expectancy system or grammar of the examinee" 
(p. 16). Oiler posits that tests which Reflect .the pragma t ic perspect i ve 
such as dictation, cloze and their variations "probably provide more 
accurate in,formation concerning language prof i c i ency .. .than -the more 
familiar tests produced on the Basis of discrete point theory" (1979, P- 9). 

The soclol i ngui.stic/et hnographic perspective entailing "the notion 
that children's school language should be viewed within a broader frame- 
work of culturally acquired communicative competence" (Philips, 1980, pp. 2-3) 
has recently begun to influence language proficiency assessment practices. 
Methodologically, this approach implies the focused observation of ^ . 
Students* language use in naturalistic settings. In contrast to 
traditional approaches to testing, it does not generally rely on paper 
and pencil type of te$ts which can be statistically analyzed. 

While traditional psychometric approaches do testing are generally 
used for purposes of identification and placement, they are recognized 
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tg' be Inadequate, Thus, the controversy remains as to the nature of 
language and how to best measure it. Issues^ which have not been 
adequately acJdressed by traditional testing procedures include such 
basic 'questions as: • . 

n * 

• What does it mean to be proficient? 



Does it mean a person's receptive/expressive 
knowledge of discrete grammatical components 
of a 1 anguage? 

Does it mean a person's knowledge of linguis- 
tic code(s) and its (theTr) appropriate use 
in different social contexts? (Note 1) 

What are the variatles which influence language use 
during communicative interactions? 

1 

^ • How should'these variables be incorporated into the 
development of language proficiency measures? 

Current research which has implications for language proficiency 

assessment practices includes research' in adult language proficiency ■ 

testing, cognitive studies which attempt to conceptualize the construct- 

of language proficiency, development of theoretical models of corrmuni- 

cative competence, studies iflvest igat i ng the validity of measures, of 

f 

communicative competence, and ethnographic/socibl inguistic studies of 
children's functional use of language. Representative research in each 
area will be reviewed. 

Research efforts in adult language proficiency testing are represented 
by the work of the Foreign Service institute (FSl) and the Educational Testing 
Service (ETS) . These efforts are discussed because of thel^ potential 
application to the assessment of,, language minority students\ 
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The Foreign Service Institute (FSl) has played a signif'icant 
role i^n the development of an oral interview testing system' to assess 
foreign language proficiency. The system has evolved over the past 
thirty years. The significance of. this effort lies in the standcrd.-^ 
Ization of: oral testing procedures, the aspects of performance that 
are to be observed, and their rating. While the FSl Oral Interview' 
T^t represents a positive effort in^ the measurement of oral language 
proficiency of adult foreign language learners, the system is limited 
in its ability to measure the .effect iveness of the communication pro- 
cess within cultural contexts (Rice, 1959), Currently efforts are 
being made to emphasize "more realistic uses of language" (Jones, Note 2 ), 
v/ith a greater stress being placed on comprehension ability of indivi- 
duals being tested. The goal of the FSl Orat Interview Test is to 
predict government employees' successful use of the target Janguage in 
overseas assignments. Although designed to assess adults' foreign 
language proficiency, it has the potential to be adapted to assess the 
language proficiency of school age LEP students-. 

« 

Clark (1980) proposes the development of a "common- measure" of 

/ 

-ip^kirtg proficiency in second and foreign languages for use with 
^ high-school and adult learners. He defines "common measure" as 
"...a uniform testing procedure that can be used with diverse groups 
of examinees in a variety of language learning situations with testing 
results reported on a single uniform scale" (p. 15). He argues that 
there is a need for development of a measure of speaking proficiency 
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that can be validly used in. a series of different situations for which 
development of specific procedures Is not realistic. In an update on 
the development of such a measure, Clark (I981) emphasizes its benefits 
and potential use: 



to further the development of a more sophisticated 
measurement procedure ; 



to make available a cost and time effective instru- 
ment which evaluates communicative proficiency in 
different situations and for different second language 
learners; 1 

to provide a highly valid and reliable instrument 
for use in the validation of other tests of speaking 
proficiency. 



Cummins suggests that the present state of the art in language proficiency 
assessment is confused because of the "failure to develop an adequate theoretical 
framework for relating language proficiency to academic achievement" (1979). 
He contends that: 

there has been a failure to adequately conceptualize the 
.construct of language proficiency and its cross-linguaj 
dimensions.^ In other words, there has been relatively 
little inquiry into what forms of language proficiency 
are related to the development of literacy skills in 
school ^contexts , and how the development of literate 
proficiency in relates to the development of literate 
proficiency in l^- 

(1980, p. 27) 

He posits that there are two dimensions to language proficiency: 
cognitive-academic language proficiency (CALP) and basic inter- 
personaT communication skill (BICS). CALP refers "to the dlTicnsion 
of language proficTency that is strongly related to literacy skills. 
BICS refers to cognitively undemanding manifestations of language in 
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interpersonal situations" (Cummins, 1930, p. 28). He hypothesizes 
that these two dimensions of language can be empirically distinguished 
and that the native (L^l and second language CL2) CALP-like skills are' 
manifestations of the same underlying dimension. Based on these hypo- 
theses, which are currently being investigated (Cummins, et al , Note 3 ) , 
Cummins suggests that ^'placement of bilingual children in different 
types of instructional programs should not be based only on 'natural 
communication' CBICS) tasks (but that) ' developmental levels of and 
L2 CALP should also be taken into account" (1980, p. 54). Thus, he 
strongly recommends that students' literacy skills be tested in bot\^ 
and L2 before placement/exit decisions are made. 

Sociol inguistic theory and research in teaching second language 
learners has brought the concept of communicafive competence (Hyrri^s , 
197^) into prominence. While many interpretations have been given to 
this concept, in general it is used to refer to mastery of communicative 
skills acquired by second language learners and the appropriate use of 
these skills during social interactions. Twb models based on this 
concept are presented here because they provide a frame of reference 
for ongoing developments in language proficiency assessment. 

Canale and Sw^in (1979) suggest a model which is based on the identification 
of features considered important for communicating. These communi- 
cation features are characterized as being interaction-based, unpre- 
dictable, creative and purposive. Communication is authentic rather 
than contrived and takes place within sbc iol. ingu i s t i c and discourse 
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contexts. Successful communication is judged on tKe basi^ of actual 
outcomes. Trie three components of the- communicative competence model 
are: linguistic, sociol i ngu i st i c , and strategic competencies. Linguistic 
competence deals with mastery of the grammar of a language. Socro- 
linguistic competence involves mastery of appropriate language use, 
with an emphasis on j^eaning and the appropriateness of* the linguistic 
forms used to convey meaning. Strategic competence refers to second 
language learners' ability to compensate, repair and use other stra- 
tegies in their attempts to communicate wj^th other participants. 

Research by Slaughter and Bennett (198I) into the nature of 
discourse of bilingual children expands on Swain and Canale's discourse 
component. Bennett (I98I) describes discourse as being temporal, 
refle;yve, multi -vocal and multi-modal. It is temporal in that it 
evolves through time. It is reflexive in .that language creates the 
context for it to be understood. It is multi-vocal in that different 
meanings and i nterpretat i^ons are always available to participants; and 
it Is multi-modal in tflat it involves the selection of varied modalities 
such as choices of grammar, lexicon and non-verbal behaviors. 

Briere (1979) developed a model which pi^cognizes soc iol i nau i s t i c 
and -1 i ngu i s t i c competence as components of communicative proficiency. 
These competencies have two dimensions: one at the abstract level, or 
linguistic/sociolinguistic competence, and the other at the performance level. 

'n 

or linguistic/sociolinguistic performance. At the performance level communi- 
cative proficiency is associated with the speaker's use of the grammar 
of the l^anguage i n appropr i ate soc i a 1 i nteract ions . 




The relevance of both Canale and Swain's and Briere's attempts 
to develop models of communicative proficiency is that they provide 
researchers and practitioners with a comprehensive framework. The 
models suggest that language proficiency tests should consider know- 
ledge of the linguistic code concurrently with appropriateness of its 
use during social interactions. 

Bachman and Palmer (I979;198l) investigated the contruct valid- ' 
acion of 1 anguage tes ts , in a two-phase study. They explored the 
validity of a simple mode] of language which consisted of two traits-- 
speaking and reading. They found that the model statistically explained 
test results better than a single factor model (Oiler, 1979). Encouraged 
by the findings, they expanded the i r research to investigate the 
construct validity of several other models of language. Using confir- 
matory factor analysis they found that the model which showed the 
highest degree of statistical .significance is a model that posits one 
single factor. and three specific trait factors: linguistic, socio- 
1 i ngu i s t i c and pragmatic. The model was developed based on Canale 
and Swain's (1979) model of communicative competence. 

Ethnographic and soc lol i ngu i s t i c studies of children in a New 

York Puerto Rican community (Poplack, I98I) add' to our understanding 

A 

of the evolution and maintenance of^ language, in stable bi-lingual 
speech communities. The ro.le of code-^swl tch i ng of bilingual adults 
and children investigated from an i ntergenerat iona 1 perspective gives 



insights into the-acqu i s i t ion and use of code-switching and its rela- 
tionship to language proficiency. 

Rodriguez-Brown and El Ias-01 i vares (I98I), in investigating the 
communicative competence of bilingual children, concentrated on the 
expressive strategies used to make inquiries. Their findings indicate 
the importance of focusing on bilingual children's language use in 
experimental test situations. 

Simich and Rivera's work in cooperation with teachers and special- 
ists from; Tucson Unified School District, Tucson Arizona, represents a 
preliminary effort to identify functional uses of language in elementary 
bilingual and mono 1 ingua I classrooms . This work attempts to cfarify 
the reasons why children and other participants communicate and how 
children's knowledge of acceptable furtctional uses of language relate 

to language proficiency.. ^ , 

* • ' . ' • • - 

In summary, theoretical and applied research from the psycho- 
linguistic and sociol inguist ic perspective is providing basic information 
that IS proving useful in the further exploration of language proficiency 
assessment practices. The research cited is intended to be representative 
of both traditional and non-traditional approaches to interpiretations 
of the nature of language, language proficiency and language proficiency 
i^ssessment- 



Concl us I on 



The intent of this- article has been" to discuss Issues of language 

proficiency assessment within 'the framework of three questions^ 

What are the basic premises upon which current language 
assessment instruments have been developed? 



' o 



o ^ What Is the state of the art in language proficiency 
assessment? 

o What implications do current research findings have 
for language prof Fciency assessment? 

In response to the first question, an overview was presented of 
the basic premises upon which currently used language assessment in- 
struments have been developed. Research efforts in the development 
of traditional/psychometric and non-traditional soc iol i ngu i s t i c/ 
ethnographic language proficiehcy assessment measures were described. 

The state of the art question was approached from a legal and 
technical perspective. The legal mandate to comply with federal and 
state regulatio.ns prompts school district personnel to use available 
"language proficiency instruments even if they "fai-1 to measure what 
they are intended to" (Oeitrich, Freeman, Z- Crandall, 1979)- Prom 
a technical perspective 'language proficiency tests, in genera!, do not 
meet validity and reliability standards. The most commonly used 
instruments are inconsistent in the way they rate the language pro- 
flciency^of the same student and the language constructs being 
measured are not necessarily compatible. 
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In an attempt to answer the third question, representat i ve 
research which has implications for the assessment of language 
proficiency was reviewed. Efforts in the development of adult second - 
language tests are important because they are attempting to provide 
a model for evaluating the* language proficiency of adult second language 
learners in a variety of situations. These efforts have potential 
applications for use with language minority students.. 

Cummins recognizes two dimensions of language: CALP and 8 ICS. 
He hypothesizes that these two dimensions of language can be empiri- 
cally distinguished and that CALP-like skills in L:| and L2 are mani- 
festations of the same underlying dimensions. Based on these hypo- 
theses he recommends that language assessment of LEP students include 
not only oracy but literacy skills in hoth^L^ and L^. 

The ethnographic/soclol ingui st ic studies cited begin to provide 
a better understanding of the language construct and how this relates 
to language use and language assessment. From this perspective, it 
is posited that language should be assessed as it Is usedln natural 

rather than exper iinenta J settings. Basic to the sociol ing^uist Ic/ 

I? 

ethnographic approach is the belief that teachers should develop 
observational skills together with a better understanding of functional 
>anguage use of participants in school settings . /The major contribution 
of this approach Is the incorporation of a sociol inguistic/anthropological 
perspectivjs to the interpretation of the nature of language, language 
use and its measurement. . - ' 



A drawback to the ethnographic/sociol ingu f&tic approach is that 
it discourages consideration of traditfonaHy measured language skills 
which are part of the language of instruction and learning In the 
school setting. In its recognition that language proficiency assess- 
ment should incl^dj both linguistic and soc iol i ngu i st i c competencies 
Canale and Swain's model of communication competence provides perspec 
tlve to the issue. It draws attention to the fact that there is a 
need to focus not only on linguistic components ' of language, but on 
soc ioljngul Stic competencies. 



Based on our experience, our knowledge of the state of the' art, 
and current research efforts , we close wi th recommendat ions for '^^l 
assessment strategies^ research, and teacher training. 

Assessment Strategies: 

• An eclectic approach to assessment of oracy and 
literacy skills Is recommended. That- is, assess- 
ment of LEP students should Include assessment of 
all four language skill areas — listening, speaking, 
reading anh writing. 

• Determination of language proficiency of LEP 
students should be based on multiple assessments 




of oracy and literacy skills in L- and C 
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A critical factor to be considered when assessing 
the language prof i clency' of language minori>5r 
students is whether or not they possess literacy 
skills In their native language* 

Appropriate use of language in* a wide range of 
social contexts should be considered an essential 
part of language prof Iciency assessment . This 
perspec-tive implies i nforma 1 observat i on of the 
students to deter^mine the appropriateness of dis- 
course used and his/her knowledge of the social 
1^ of interaction established by participants 
fifferent social contexts. - 




Assessment instruments should be selected according 
to their appropriateness for measuring oracy and 
literacy skills as they relate to the curriculum 
objectives- of the school program. 



Research ; 



Efforts ta improve statistical reliability and 
validity as well ^s ecological validity of current 
instruments in use should be encouraged. 

Research efforts should be directed toward 'the 
development of language prof i c i ency measures 
appropriate for use with LEP students with 
special needs. ' 

There is a need for further research to better 
explain how the functional uses of language in ' ■ 
different domains, i.e., community, home and' 
school relate tck language prof iciency. 

Research into the acquisition and development 
of discourse strategies children use for * 
^.communication should continue. 



Teacher Training 



Teachers should be trained in the basics of 
traditional language proficiency test development 
and its interpretation. 

Systematic and continuous teacher training in 
socio 1 inguistic/anthropological approaches to 
language, together with training in observa-tional 
strategies should be encouraged. " 
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Reference Mc^s - c- 

I * 

Social context refers to cultural/physical contexts In which 
communicative events take place. The social context is an 
important variable. which influences communicative outcomes. ^ 
In school settings both academic and non-academic events 
are common. Examples of social contexts range from 
math class to recess. 

Jones, 0. Persona] Communication. Foreign Service fnstltute, 
Rosslyn, VA, June 17, 1981./ 

Cummins, J., et al. A Study of the Relationship between First '' 
Language Proficiency and the Development of Second Language " 
Proficiency in Japanese and V i etnamese ■ I remicraht Students . 
Research in progress funded under the ALPBP Project, 
InterAmerica Research Associates, Rosslyn, VA, 1979-1982. 
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Summary of Presentations 
at ' 

The Language Proficiency Assessment (LPA) Symposium 

The Language Proficiency Assessment (L?A) Symposium, held Marcji lif-l8, 
1381, at Airlfe House i n' War renton , Virginia, was planned and implemented as 
part of the Assessment of Language Profici ency of Bilingual Persons (ALPBP) 
project. Thp goals of the ALPBP project, funded by the National Instrtu'te of 
Education (NIE) and administered by I literAmer i ca Research Associates, Inc., 
are to. support research which further develops the constructs of language 
and communicative competence and its assessment and to develop programs to 
train teachers in alternative modes of assessing the language proficiency 
of language minprity students. 

The LPA Symposium represented a major effort toward integrating both the 
insights gained from findings emerging from the research component and the 
implementation of the teacher training programs of the ALPBP project. The * 
Sympos ium^ provided a forum where a broad spectrum of researchers , practitioners, 
and policymakers met to discuss the major issues and research findings which 
affect language proficiency assessment practices. The Symposium also provided 
a structure for participants to make practical recommendations directed at 
influencing federal and state policies- regarding language proficiency assess- 
ment research and practices. Another abjective of the Symposium was to 
encourage the participants to develop a network of communication for the 
purpo'ses of exchanging information and incorporating this knowledge into 
their areas of responsibility. 
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Researchers were represented by scholars involved In the development of 
models of communicative competence, related empirical research, and the develop- 
ment and validation of tests ofManguage proficiency and/or communicative 
competence. Practitioners included teachers and school administrators engaged in 
the implementation of programs which require the application of language 
proficiency assessment strategies. Policymakers were individuals who play an 
important role in the funding of educational research ^projects related to 
language proficiency assessment and who are influential in the establishment 
of pol icy in this area . 

The participants interacted .through the presentation of'papers, reactions 
'to presentations, and informal discussions. The main goals of the Symposium 
were selected by the organizers based on a survey of concerns of researchers 
and educators. The goals were: 

• to develop a working definition of commun feat I ve competence/ 
language proficiency; ■ ^ . 

to make recommendatioas for the assessment of language 
minority students for the'purpose of entry/exit into 
appropriate educational programs; and 

• to develop an agenda for future research based on present 
and past research. 

The issues in the area of language proficiency assessment ranged from 
theoretical questions regarding the nature of communicative competence to 
the application of research findings". Centr-al to the discussion of language 
proficiency assessment was the acknowledged need to clarify the nature and 
scopesof communicative competence and its relationship to language proficiency. 
Topics of discussion in thi% regard included research findings concerning the 
nature- of children's language use and the role of first. and second languages 
In the learning of literacy-related skills. 
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Language tests and testing methods were also topics addressed by the 
participants. Questions were raised as to what these tests should be 
measuring and why. . Many of the participants were concerned with the issue 
of 'the reliability of currently-used l.anguage prof i ci ency .assessment 
instruments as well as with the development of new, more appropriate 
measures. A mul t i-di sci pi i nary approach to language proficiency assessment 
and the development of more innovative methods of language testing was 
supported by participants.^ An apprc^ch of this type uti 1 izes information 
from such areas as psychology, anthropology and 1 ingu'istics , thus providing 
the opportunity to gain insights from d i f ferent' perspect i ves into patterns of 
language use and related topics. A sociol inguistic/ethnographic perspective 
.to language proficiency assessment , for example, was one of the unique 
approaches which was examined at the Symposium. 

* 

The impact that new research findings have on the e«5tabl ishment 
of government pol i cy and, in particular, of federal guidelines in the 
area of language prof i ciency assessment , was a type whiciri most of the 
participants believed required ser ious. cons iderat ion • Since language 
proficiency assessment practi ces are currently undergoing .a period of 
change and reeva luat ion , it was suggested that the federal government, 
in revising the LAU guidelines, provide a means of incorporating new research 
findings regarding the nature of language which have implications for 
assessing minority students. 



Following are brief descriptions of the presentations at the LPA 
Symposium. The summaries are organ ized *and described based on the following 
categories: 

papers dealing with Che, nature and scope -of communicative 
competence and its measurement; 

papers reporting applied research; 

papers which incorporate ethnographic/sociol inguistic 
methodologies and theories;^ , 

papers dealing with policy and educational issues relating 
to entry/exit procedures; 

papers sunynarizing the symposium themes; and 
summary of participants understandings and recommendations. 
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^ Nature and Scope of Communicative Competence and IC5 Measurement 

• % 

* In "Wanted: A Theoretical Framework for Relating Language Proficiency 

to Academic Achievement Among Bilingual Students," Cun]mins argues that- "a ffi'ajor 
^: reason for the confused state of the art of lan^age proficiency in 

bilingual programs ... stems from the failure to develop an adequate theoretical 
framework for relating language prof i ci ency to academic achievement." He 
contends that without such a "framework it is impossi We .ei ther to develop 
rational entry/exit criteria for bilingual pcpgFams'or to design testing 

frocedure? to assess these cri teria ." He provides an overview of the evolu- 
tion of a proposed framework, which was based on "the fact th^t the develop- 
ment of age-appropriate proficiency in two languages appear to be 'assoc i a ted 
with cognitive advantages, whereas the attainment of only relatively low 
levels of bilingual proficiency is associated with cogn i t i ve d I sadvan tages . • . " 
It was thus hypothesized that: 

The first, "^ower threshold level, must be attained by bilingual 
children in order to avofd cognitive disadvantages and the 
second, higher threshold, (is) necessary to allow the poten- 
tially beneficial aspectS'of bilingual ism to influence cognitive ^ • , 
growth. • ^ 

Because the threshold hypothesis did not explicitly relate first and second 

language prof i c i enc i es , 'Cummi ns supplemented it with the j n te^dependence 

hypothesis whiqh Suggests "that and academic proficiencies (are) develop-* 

mentally independent, i.e., in educational contexts the development of second 

.language proficiency (is) part ial ly dependent upon the prior level of develop- 

ment of prof i^ciency." 

^ Cummins m^kes the distinction "between 'surface-fluency' and more 

cogni t I vely--and academical ly--related aspects of language proficiency." 
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He refers to the distinction as ''basic interpersonal communicative skills" 
(BICS) and "cognitive-academic language proficiency" (CALP) . Within 
the BICS-CALP framework, he reformulates the interdependence hypothesis 
in terms qf the "common underlying proficiency" (CUPX modeh In this model 
an individual's proficiency is held to be-'"theoret i ca 11 f' capab I e of being 
developed in efther language."^ He contends that educators have failed to 
account for the distinction and, for this reason, have actively contributed 
to academ'ic failure of language minority students. He asserts that, "the 
CALP*-BICS distinction was not a distinction between 'communicative' and 
'cognitive' aspects of language proficiency.'' Because of "concerns 
expressed about possible misinterpretation of their meaning and implications,' 
he states that although he avoids using .the terms BICS and CALP, "the basic 
distinctions highligfhted by these terms are unchanged," 

/in a "cursory ""examinat ion" of currently available tanguage proficiency 
measures, Cummins found ^reat variations in what 'language tests purport to 
measure, fiespite this finding, he Indicates that it is not -startling 
."in view of the lack of consensus as to .the nature of language proficiency 
or communicative competence." He contends that the most important issue to 
be addressed in the development of entry /exit criteria in bilingual education 
^programs is to determine the e;^tent to which measures of language proficiency 
should be related to measures of academic achievement. The assertion is 
made that "without a the'oret f ca.l framework wi thin, wh ich language proficiency 
can fc^e related to tris development of academic skills there is no basis for 
choosing between alternative tests V/hich are clearly measuring very different 
things under the guise of 'language proficiency'." 



Cummins concludes by highlighting requirements for a "theoretical 
framework of language proficiency relevant to bilingual education in the^ 

UrFi ted^ States . . --~-~-n^>s^ 

First, such a framework must incorporate a developmental ' 
. perspective such rhat .those aspects of language proficiency 
which are mastered early by native speakers' and learners 
can be distinguished from those that continue to vary 
•across individuals as development progresses; second, the 
framework must be capable of allowing differences between 
the linguistic demands of the school and those of. inter- 
personal context's outside the school to be described; 
third, the framework must be capable of allowing the 
developmental rel'ati onshi ps between 'L^ and proficiency 
to be described. 

Rudolph Troike, in ''SCALP-Soc i a 1 and Cultural Aspects of Language^ 
Proficiency," examines the validity of Cummins' CALP and "interdependence 
hypothesis." He considers the significance of social, contextual and cul- 
tural factors in academic achievement and the assessment of language profi- 
ciency. Troike states that, contrary to the ideas expressed by Cummins', 
CALP may be merely an indicator of a student's "acculturation" rather than of 
cognitive ability. Troike theorizes that social and cultural factors rattier 
than linguistic factors, account for most of the disparities in academic, 
achievement among language minority students. He- indicates that while there 
is little understanding of.the "ways home background, i ncl ud i ng ,SES influence 
the learner,' there is even less of an understanding of how "sociol ingui stic/ 
cultural attitudes, expectations, and behaviors manifested by the teacher 
and others" interact to stimulate or^/etard the individual, learners' progress. _ 
Because these factors are largely unaccounted for in Cummins hypotheses, 
and may only "reveal accul turative approximations to middle-class western 
cultural norms and behaviors," Troike strongly suggests that much more 
research into social, cultural, individual and linguistic factors will 
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be needed before conclusions can be reached concerning the relationship: 
between lar>guage proficiency and academic achievement o^ language 

minority students. . 

^ \ ■ 

* 0 

Cynthia Wallat and Gladys Knott present- a framework for a discussi.on 
of cummun i cat ive competence by providing a review of theory perspectives 
on learning and performance along with an overview of. program irtrp.l 1 cat i9ns 
in "Communicative Competence: .Analysis of Models, Characteristics and 
Program Implications.'' Wallat and Knott summarize "approaches to competence- 
from chi Id <^evelopment , social psychology, ethnology, and education research 
traditions" Jn order to .provide a "historical perspective on the notion of 
competencies." They furnish this overview in order to create a framework 
for the discussion of "current perspectives" on communicative competence. 

Ellen Rosansky reviews data from studies concerned with the validity 
of several currently used oral assessment instruments in "Future Perspec- 
tives on Research in Oral Language Proficiency Assessmep t .*" She also dis- 
cusses the recent 1 y :wi thdrawn LAU regulations and current research efforts 
in oral language proficiency assessment. The data presented regarding the 
lack of validity of currently used^oraT assessment instruments supports 
Rosansky's statement that the present state of testing in this area is not 
very encouraging. "Indeed it seems unlikely that we can validly and accu- ' 
(^rately assess the English language prof Iciency. of limited or non-English 
children at present." .She qualifies her pessimism in this.- re'gard by indi- 
cating that there is a promise of hope in research which is currently in^. 
progress. 
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Appl led Research 

Vanous. attempts to apply these and other theories to different aspects 
of language proficiency assessment comprised a major portion of the papers 
presented at the Symposium. The topics addressed ranged from the develop- 
ment of new test constructs, to research on the acqi^isition of literacy 
related skills, to some of the more innovative approaches being used for 
language assessment. 

Michael Canale describes an ongoing project to develop two communicative 
proficiency instruments for use in French language schools in Ontario, 
Canada. One instrument is to be used for testing French as a first language' 
and another for testing EnglisJi as a second language. In the paper, "A 
Communicative Approach to Language Assessment in a Minority Setting," 
Canale outlines the theoretical framework upon which the proposed tests of 
communicative competence will be based. Communication in the framework in- 
eludes four areas of language skills: grammatical competence, sociolin- 
gulstic competence, discourse competence and strategic competence, "it is 
assumed that this theory of communicative competence interacts with other 
systems of knowledge and skills (e.g., world knowledge, general perception 
strategies), as wall as with a theory of human action (dealing with such 
factors as volition ancT persona I i tyf. " Canale points out that although the 
theoretical framework has some Inadequacies it has "proven useful in sug- 
gesting specifications for context, formats and scoring criteria in commu- 
nication-oriented language proficiency assessment." He indicates that the 
project, in addition to having Immediate direct application, will provide 
the opportunity to explore important issues in language proficiency assess- 
ment, such as how accurate the proposed theoret i ca 1 - framework may be and 
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what relevance "communicative proficiency" may have to "academic achFeve- 
ment in a langage mrnority setting." 

Lyle Bachman and Adrian Palmer d i scuss ''the i r attempts to develop a model 
of communicative competence and valid tests of its components in "Some 
Comments of the Terminology of Language Testing." They discuss three ap- 
proaches to language proficiency testing: The Ski 1 1 -Component Approach, 
the Communicative Approach and the Measurement Approach. They then "propose 
an interpretation of the Canale/Swain communicative approach within the 
general framework of measurement theory." In jthe course of integrating the 
models, they delineate a set of hypotheses which they developed, regarding 
language abi 1 i ty . 

Because the use of test terminology has become imprecise they, then, 
attempt to "provide some more precise definitions of terms used to describe 
language proficiency." Among the terms they define are: linguistl'c^ 
competence, communicative competence, language skills, linguistic performance, 
communicative performance, measures of linguistic performance, and measures 
of communicative performance. 

In "Improving the Psychometric and Criterion Reference Q,ua 1 1 1 i es of 
Integrative Language Tests,"' Gary Cziko described research efforts to deter- 
mine whether modifications of existing integrative testing procedures could 
be made to improve (their) psychometric, criterion-referenced, and practi- 
cal qualities. Specifically, Cziko investigated the effects of changing 
the "standard procedures of constructing, administering, and scoring English 
as a Second Language (ESL) dictation tests. He describes a study for 
which he constructed a dictation test that would: 
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• **be appropriate for a wide range of abi I i ty in ESL, 

i.e,, from near zero... to native speaker level 
competence; 

• be significantly easier and faster to score than the 
common scoring procedure...; 

• be a good predi.ctor of the individual's response to 
each i tem; and 

yield scores that would be directly interpreted with 
respect to specified criterion levels of English 
. -proficiency.'* 

Analysis of 102 students' dictation test results indicated that: 

• the difficulty of a dictation test can be manipulated 
by changing the length of segments; 

• "exact spelling criterion" can yield a group of items 
which form an accurate Guttman scale of an individual's 
total score; and 

• scoring a test by segments using an exact spelling 
criterion is much faster than scoring y^crd by word. 

Cziko concludes by suggesting that tests be made more meaningful and more 

consistent with evolving Insight into what language proficiency is. 

Moreover, he points out that "test scores themselves (should be made) 

more mean i ngf u 1 . " 

Richard Ouran discusses the 5ignificance of communicative competence 
research in terms of the development and use of integrative proficiency tests 
in "Some Implications of Communicative Competence Research for Integrative 
Proficiency Testing." Integrative proficiency tests, according to Duran, . 
are based on the "notion that linguistic skills need to be studied as they 
interact with each other in naturally occuring segments of language use, 
(even though) the contexts for assessment may vary from formal testing con- 
texts to ellcitations of speech or writing in situations in everyday settings 



He states that ^'the interpretation and theoretical design of proficiency 

tests" may be improved ''by attending to some of the discourse and interactional 

ski 1 1 s uncovered in communicative competence research." Integrative 

proficiency testing can benefit, he believes, from communicative competence 
i n two ways : 

• recognition or investigation of how a student'.s 

language skills will vary according to his or her 
' background, the "examiner's characteristics, dis- 
course topic and other parameters of speech event;" and ^ 

J, I 

0 "future development' of new assessment procedures 

sensitive to social influence ondiscourse behavior 
and communicative competence," 

There were a number of papers presented which addressed the theme of ^ 
the acquisition of literacy related skills in first and second language. 
Several individuals presented research, completed or in progress, which 
attempt, to test theories in this area. 

Jim Cummins, et al, reports on a study carried out for the purpose 
of evaluating the "linguistic interdependence" hypothesis. For the study, 
"Linguistic Interdependence Among Japanese Immigrant Students," Cummins, 
et a>l , tested ninety (90) high socioeconomic status Japanese students 
attendirig grades 2 S 3 and 5 S 6 of the School of Supplementary Japanese 
Studies in Toronto, Canada. Using group Engli'sh and Japanese academic 
language proficiency measures, individual English academic measures and 
Japanese and English intervie\ys, the researchers found that older immigrant 
students whose first language proficiency is "better established at the 
'time of intensive exposure to the second language, not only make more\rapid 
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progress In acquiring most aspects of the second language but also main- 
tain and/develop their first language more adequately than students who 
immigrate at younger agesJ' 

In his presentation, ''Graphic Sense and Its Effects on the Acquisition 
of Literacy," Eduardo Hernandez-Chavez describes the relationship of 
graphic sense to reading social izat ion and reading readiness. The framework 
for the study, he explains, was based on the hypothesis that success in 
learning to read depends upon the level of graphic development in the 
child and that th^ rate of this development is related to the quality of 
the child's socialization experiences. He indicates that the research 
questions i nvest i gated were: 



What is the nature of children's pre-reading 
conceptual izat ion of the printed word? 

, • How are children socialized to print, i.e., what 
attributes and pract i ces wi th respect to reading 
are found in the home? How is this socialization 
related to the development of children's graphic 
sense and their readiness to read? 

Participating in the study were approximately 14 children ranging from 

pre-school to first grade. in addition, he states, a sample of pareats 

were surveyed to ascertain how socialization to print in the home relates 

to the acquisition of literacy. 

The results of the study, he concludes, support the proposition 
that children pass through developmental stages in their understanding 
of wr^itten language and that the level of graphic sense is related to the 
nature of a child's exposure to and interaction with* written language at 
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home. Education and literacy of parents, as well as social literacy 
activities in the home are also important factors which affect the 
development of graphic sense. 

Besty Tregar describes in "Oral and Reading Abilities of Bilingual 
Program Students/' her investigation to determine whether second language 
oral ability or first language reading ability is a more accurate predictor 
or condition for the development of seoond language reading skills. The 
sample for the study, she indica.tes, were four hundred non-English 
dominant children. Of the total sample, two hundred were Chinese speaking 
students in grades 3-8 and two hundred twenty Spanish speaking students 
in grades 3-8, Oral dominance, as well as cloze reading tests, developed 
by the Boston Public Schools, were used for the data collection, 

,^ Tregar states that for elementary students in grades 3-5, it was found 
that there was a higher correlation between Lj and reading comprehension 
than between oral ability and- L2 reading comprehension. For the middle 
school students a higher correlation was found between L2 oral ability 
and reading- comprehension. 

In '^Language Proficiency in Bilingual Native American Schools: Problems, 
Strategies and Prospects" Steven Chesarek discusses testing issues as they 
relate to native American groups. He identifies limitations of using 
testing instruments in cross-cultural settings. Hi.s experience base is 
the Crow reservation in southeastern Montana. He considers testing a 
decision making tool which must be carefully monitored. He argues that a 
"test by itself is useless if it is not utilized in an appropriate design."' 
Chesarek provides -examples of some "research strategies to minimize test 
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M imi tat ions. Among theXstrategies he recommends are: the development of 
a base which provides a better understanding for interpretation of test 
results in cross-cultural settings, and the need for item analysis when 
testing across cultures because total scores may be misleading. 

In concluding, Chesarek makes' the point that "the. . .ent i re testing 
activity (is lost) if we are not able to select appropriate instruments 
and use the information they provide to make initial deci s ions' about suitabi 
programs and to refine those programs based on additional information 
provided by later testing." > 

Zoe Ann Hayes provides a report gn a study of English and Spanish 
proficiencies of Hispanic third grade students in "^Limited^ Language 
Proficiency of Mexican American Third Grade Students: A Problem in the 
Definition and Measurement of B I 1 i ngua 1 i sm. " The purposes of the study 
were to explore whether: 

• verbal skills of limited bilingual proficient students 
are distributed across 1 anguages ' and whether this dis- 
tribution is a function of domain; 

• students are classified as limited bilingual proficient 

on communicative as well as linguistic competence measures; and 

• the method of scoring relates to the designation of limited 
b 1 1 i ngua 1 prof i ci ent . 

The researcher makes use of written tests, tests of communicative competence 

In both English and Spanish as well as a measure of developmental level to 

determine the level of cognitive development and how it relates to limited 

and'.^fluent language proficiency. ' ^ 



The results of this investigation, Hayes suggests, "do not lend 
support for the conclusion that limited bilingual language proficiency 
is a widespread phenomenon." Rather, the conclusions indicate that the 
"use of language tests which measure only one aspect of language (i.e., 
grammar or vocabulary) and which provide cutoff (levels are) of questionable 
validity-" 

Complicating the issue of various tests measuring different skills, ' 
she states, is the lack of comparabi 1 i ty in the level designations provided 
by test developers. The cutoff points used to designate limited and profi- 
cient status in a language are not anchored on criteria which indicate 
whether students can or cannot functTon effectively in English-only Instruc- 
tion. As currently .avai lable, many language proficiency instruments faij to 
distinguish between those who may be truly limited or proficient in a lan- 
guage and those who are not. The researcher suggests the use of specific 
external criteria (i.e., grade 1 evel ach i evement) to validate cutoff scores 
and level designation. In addition, language proficiency tests 'which desig- 
nate proficiency levels based on monolingual norms may not be valid indica- 
tors of language proficiency sufficient to succeed in English-only class- 
rooms, without special language assistance. 

It is suggested by the researcher that the concurrent and content 
validity of language tests and the predictive validity of cutoff scores,' 
lead to the possible mi scl ass i f i cat ion of non-English language background 
(MELB) students. Approximately thirty percent of the students in this 
study v/ere inconsistently classified using any two instruments. 
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Error in classification also occurs if a bilingual's language skills 
are measured without consideration of distribution of skills across two 
languages. I t was thought that perhaps students in San Jose, California 
had been raised in diglossic environments using Spanish for one set of 
functions and English for another. Results'of this investigation indicate 

V 

<'■« - 

that these students do not appear to come from diglossic bilingual environ- 
ments. Rather, students use English and Spanish in both home and school 
situations; although stronger in Spanish, their languages do not seem to be 
separate as a function of domain. 

The lack of distribution of language skills across languages and 
domains might also be related to the^^ttfdents age and length of residency. 
Due to the restricted range of the tik}d grade, there was little variation 
in length of residency. 

Finally, the following conclusions related to the concept of '*semi- 
lingual ism" were drawn: By definition, "sem i 1 i ngua 1 i sm" is limited profi- 
ciency in both and L^. The results of thrs investigation Indicate th^t 
"semi 1 ingual ism'^ exists only as a concept. There is no reliable evidence 
for the existence of tHe phenomenon. Since there appears to be no way to 
reliably measure the phenomenon nor' unamb i guous 1 y identify it, it is not 

useful as a construct. Some literature on "semi 1 i ngual i sm" suggests that 

♦ 

j limited bilingual language proficiency ma^ have negative cognitive results. 

No indication of this relationship was found to exist for the study popula- 
tion..^ Although any one test or combination of tests indicated that a student 
may appear to be limited in both Lj and (and this identification was likely 

L " ' 

*^ to be unreliable and of questionable validity), no differences incognitive 

L . ^ 
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development were discovered between limited and proficient groups of bi- 
I ingua 1 students . " 

The needs of As i an-:Amer i can students are examined by Rosita Galang 
in "Native Language Assessment of Asian-American Students." Galang's dis- 
cussion centers around four topics: 

• the need for the language assessment of Limited English 
Prof icieht/Non-Engl Ish Proficient (LEP/NEP) students; 

• native language assessment of Asian-American students; 

• recent developments and controversies in language testing; and 

• future directions for research and development. 

"Evidence is provided which supports Galang's conclusion that the needs 
of Asian-American and other minority language groups in the United States are 
far from being adequately met, that "assessment in Asian languages is still 
in i tsr embryonic .stage." 

Children with (special) learning disabilities and the appropriateness 
of bilingual education in meeting their needs are issues considered by 
Margaret Sruck in her presentation "The Suitability of Bilingual Education 
for Children wit'h Special Needs." Bruck's discussion is based on results 
of two Canadian studies designed to determine whether the same array of 
symptoms would appear if education occured in the mother tongue." 

The first study focused on: 

• whether exposure to a second language interferes with 
the language disabled (LD) child's acquisition of 
f i rst language ski lis; 

Si 
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• whether the language disabled children acquire oral 
proficiency in a second language; and 

• whether language disabled children acquire competence 
in first and second language literacy skills. 

Two groups of kindergarten language disabled children, one schooled 
in French immersion programs, and another schooled in English, were" 
compared to children who were not language disabled. Children were 
assessed over a three year period. 

The second study "was designed to examine the effects of French 
immersion programs on a more heterogeneous group of 1 earn i ng d i sab 1 ed 
children. (Although) oral proficiency skills were normal (the students) 
were delayed in the acquisition of reading and writing skills." 

Bruck concludes that the findings from the studies indicate that: 

(it is feasible) td educate bilingual disabled 
children in "additive" bi 1 inguals, envi ronments . 
Given the appropr i a te . . . cond i t ions such students 
can learn a second language wi thout impeding 
normal development of first language and cogni- 
tive academic skills. However, bilingual education 
by itself is not a solution for their specific 
learning prob 1 ems . . . B i 1 i ngua 1 programs should not 
be viewed as a special education service, but' ^ 
rather an environment where children, regardless 
of their academic or cognitive potential, can 
acquire proficiency in two languages, and knowledge 
of two cultures while maintaining their respective * 
ethnic identities. 
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A revie'/Aof literature on commun I cat.i ve competences was provided 
bV Arnulfo Ramirez along with the results of research on communicative 
proficiency by Politzer and Ramirez in "Issues in Measuring the Commu- 
nicative Proficiency of Language Minority Pupils." In his review, 
Rami rez examines what he considers to be four major areas ofi communicative 
* competence: . . - 

• linguistic and communicative competence in language testing 
theory ; , ' " 

• def ini tions of communicative competence; 

• assessment of communicative competence; and 

• factors which influence pupil performance on linguistic 
and communicative proficiency tests. 

Rami rez presents research findings to:' 

• clarify the relationship between communicative add 
linguistic competence and the i mportance of one over 
the other in measuring linguistic ability; 

• determine the relative concurrent and predictive valid'ity 
of the two competencies in terms of pupil achievement; and 

• determine how individual student characteristics 
influence performance on linguistic ^nd communicative 
competence tests. 

Students from four different schools in the San Francisco and Los 
Angeles areas were tested using the English and Spanish Bi 1 ingua I Oral 
Language Tests » the English and Spanish Active Communicative Competence Tests , 
the English and Spanish Receptive Connmun i ca t i ve Competence Tests , and the 
English and Spanish Soc iol ingu i s t i c Competence Tests . Students were mixecj 
Mexican-American and Anglo-American with some students having recently 
arrived from Latin America. They ranged from grade four {k) through senior 
high school . ' 

' ^ 66 - 
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Ramirez reports the following conclusions: 

• home language (Spanish) has a negative relation to 
English language measures and a positive association 
with Spanish linguistic competence and Spanish 
communicative competence; 

• self-concept relates positively to communicative 
competence in both languages and to linguistic 
communicative competence in English. See io I i ngu i s t i c 
competence is associated with a positive sel?- 
concept; 

• field independent learning style is related to both 
English lingui^stic competence and communcative 
competence at the high school level; and 

• field independent learning style is primari ly 
associated v/ith communicative measures at the 
elementary school level. 
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Ethnographic/Soci Dl I ngui stlc.Approaches to Language Proficiency Assessment 

Various Individuals at the Symposium presented research which involved 
what has been c-illed an ethnographic approach or a study i»n, which data 
related to children's language skills has been collected in more natural 
surroundings rather than in the classroom. This approach places much more 
emphas i s »on the use of observation of children in natural contexts as opposed 
to traditional tes t ing/exper imenta 1 m'ethods 

One such approach was described in the papers of Sus^n Philips', 
"Bilingual Language Assessment: An Ethnographic Approach," and Charlene 
Rivera and Carmen Simich's "Ethnograph i c/Soc i ol i ngu i s t ic Issues and' the 
Assessment of 8 1 I i ngua 1 .Students Language Proficiency." Philips, Rivera 
and Simich describe the implementation of a teacher training program 
implemented in Tucson, Arizona which utilized a non- trad i ti ona 1 approach 
to language proficiency assessment. The approach which is soc iol ingu i s tic/ 
ethnographic in nature is based on the premise that language encompasses 
"the child's full range of social uses of language and nonverbal -s igaa 1 s 
and is not isolated to just mastery of those abilities necessary for the 
acquisition of literacy-related skills." 

Philips provides a description of Phase I of the teacher training pro- 
gram where the focus was on "three aspects^of language proficiency as relate 
to language minority students." Those aspects were: 

• Models ov Language Prof-ciercy; 

• Language Proficiency in the Bilingual Classroom; and 

• Language Proficiency in the Bilingual Community. 
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Through the training, teachers were introduced to basic anthropologi- 
cal and ethnographic concepts related to language assessment, and were 
guided in the exploration of the nature of children's language proficiency 
in both classroom and community contexts. Sources of information included 
lectures, readings, and discussions. 

Rivera and Simich describe Phase II of the training which was based 
on the theoretical and methodological issues introduced by Philips. Through 
the training, participants developed an ethnograph ic/soc i ol i ngu is t ic assess-, 
ment instrument, the Teacher Observation System ( TOS> . More importantly, 
two major outcomes- of the training were: 

• a greater "awareness of the holistic nature of language; " and 

^- 

• '^changes in teachers' philosophy of education as reflected in 
their se 1 f -assessmen t of classroom organization and management 
practices." 

Shana Poplack discusses findings of a series of ongoing studies of 
language maintenance and change in the bilingual community in East Harlem,, 
New York in "Transcending Testing in Assessing Commun Ica t i ve '^tompetence . " 
The purpose of the first set of studies, she states, was to "ascertain 
whether Spanish was being maintained among the (500-600) adults in the 
communFty, what their feelings were regarding maintenance or loss, and 
whether and how the variety of Spanish they spoke has been affected by 
close contact with English," Data was collected by "means of long-term 
participant observation, detailed attitude questionnaires, and quantitative 
socio'-l ingui Stic analyses of selected linguistic features." 



Poplack indicates that analysis of the data shows that: 

• the adults in the community are bilingual to some degree; 

• they believe "they speak good Spanish;" 

• English and Spanish are not exclusively used v/ith any 
domain; 

• the majority of adults want their children to speak Spanish 
as a first language and/or acquire it simultaneously with 
English; 

• "all sectors, school, family, and community, must share 
in the responsibility of maintaining Spanish;" and 

• that "most younger Puerto Ricans of the third generation 
prefer English." 

* ■ 

Poplack indicates that that data suggests "evidence of a language shift." 
In an effort to investigate this, a study of "the languagl^ d istr ibution among 
. . • (16) children in the community" was undertaken. The purpose of the 
study was to ascer ta i n whether English was in fact more predominant and 
what effects family, community and school h^ve in "affecting maintenance 
and loss." Data was collected utilizing the same methodology as in the 
adult stuciy. Findings indicate that "those developments which have been 
shown to hold synchronical 1 y in adult speech are being effectively trans- 
mitted to the y|^unger generations." Poplack concludes that "the patterns 
of communi capper? which are acquired early as well as positive attitudes 
toward learning and use of* Spanish combined with the demographic facts 
ensure the perpetuation of bilinguallsm in the community." 

In her -presentati on , "Studying Puerto Rican Children's Informal Education* 
at Hone," Jacob describes a study in progress of Puerto Rican children's- 
sk i 1 1 s educati on at home. The focus of the study was on the teaching and 
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learning of study skills in the home of twenty-nine children of. middle and 
lower class levels attending kindergarten, Jacob reports preliminary results 
for the girls in the sample. In general, it was found that "most of the 
girls' literacy learning activities were self initiated and that this is 
consistent with the Puerto Rican concept of capacidad School literacy 
artifacts play an important part in the girls' home literacy activities. 
The findings of the study,, Jacob reports, ''do not support the generalization 
from cross-cultural literature that observation is a primary method of 
informal education." They "do support the genera 1 i zat ion that participatory 
learning is impportant" in this context. 

Flora Rodriguez-Brown and Lucia El ias-01 i vares use a discourse approach 
to language proficiency assessment by focusing on the use of questions in 
Spanish and English in "Linguistic Repertoires, Communicative Competence and 
the Hispanic Child." Using video and aud io* equ i pmen t , Rodriguez-Brown and 
El ias-01 i vares observed nineteen (19) ch i 1 dren ^f rem two classrooms consisting 
of white, black and Hispanic, English-speaking children along with a small 
group of Hispanic children with ^ow English proficiency, The major finding cf 
the research was that "questions are most often employed in the language 
in which the child is more proficient, and the questions are often determined 
by the type of setting or activity in which the children participate." 
Rodriguez-Brown and El i as-01 i var6s conclude by stating that a better under- 
stand'lng of children's communicative competence is gained "when the whole 

language repertoire of children is analyzed from an integrative perspective." 

■\ ■ • 

A framework for analyzing the discourse of English and Spanish speaking 
children is offered by Helen Slaughter and Adrian Bennett in "A Sociol i nguist ic/ 
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Discourse Approach to the Description of the Communicative Competence of 
Linguistic Minority Children." Spanish and English communicative inter- 
actions of Anglo and Mexican-American students from Tucson Unified School 
District were taped and analyzed in an effort to develop a methodology for 
identifying, describing and evaluating those discourse variables by which 
participants negotiate, or fail to negotiate mutua I understandings. 

• Slaughter, and Bennett indicate that the study provi-ded insight into 
the developmental acquisition of discourse skills and their relationship 
to language proficiency. FoV example, for kindergarten children they 
found that the evaluation of a child*s proficiency must be based upon the 
meaning agd comprehens i b i I i ty of the child's utterances. It must also 
include consideration of the conversational context established within the 
elicitation process. For elementary children, grades 1-5,- they focused 
their analysis on the adequacy of s tuden t--adu 1 1 examiner dialogue and the 
student^s extended discourse on a topic. The discourse features they found 
to be related to proficiency were: coherence and appropriateness of 
utterances, complementarity as a conversational partner, effective use of 
prosody, provision of adequate background information prior to point making 
completeness of information, richness .of complexity, flexibility and range 
of communicative competencies, point making and highlighting, summarizing 
and use of verb tenses in narrative discourse. Slaughter and Bennett con- 
clude with the caution that: 

. i 

this sort of research needs to be supplemented by ethnographic observa 
tion, not only of the forms and uses of discourse in the classroom 
*and school playground, but in other community environments as well. 
However, simply gathering more data on the forms of discourse in 
other settings is itself not enough to answer the question of what 
constitutes proficiency in a language. Rather, this sort of in- 
vestigation itself needs to be framed in a larger investigation of 
the uses these forms are, or can be put to. 
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i Policy and 'Educational Issues Relating to Entry/Exit Procedures 

V . '^^^ l3st major theme which was addressed in the presentations related 

to issues in language prof iciency assessment in a policy context. Several 
presenters discussed attempts made by school districts and s ta t/C^^govern- 
ments to comply with legal mandates with regard to bilingual education, 
while others considered the underlying social and political issues of 
establishing policy in this area. 

Josue Gonzalez examines the social and political context of language 
proficiency assessment in ''Political Issues and Language Assessment," 
After outlining reasons for which language proficiency assessment is neces-' 
sary, Gonzalez suggests that two important questions with regard to language 
minority students should be kept in mind when establishing procedures for 
language assessment: 

♦ ''What are the rules under which language mi nor i ty popu 1 a t ions 
must play in order to participate most effectively in this 
society and (partake- in) its benefits and responsibilities'?'^ 

• "How evenhanded do we want to be as^'a society about distributing 
things like power, resources, and prestige to different language 
groups?" 

j Gonzalez suggests that these and other important social questions underlie 

policy decisions in this area and advises that those involved in language 
proficiency assessment be aware of the social and political context within 
which they are working. 

Future deve lopmefi ts in the area of bilingual education are discussed 
from a legal perspective by Gabe Kaimowitz in "Some Random Legal Ramifications 
Affecting th^ Future of Bilingual Education in the United States." A brief 
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legislative history of bilingual education is given beginning with its roots 
in the Civil Rights legislation of the 1950's. Kaimowitz concludes that 
**there are sufficient laws and decisions on the books that will permit com- 
munities to fight for adequate bilingual education programs despite the 
displeasure expressed against them by public, press or government agencies." 
He goes on to state that legislation "exist(s) to provide authorization and 
reason for appropV iat ion for (bilingual education) programs." 

Two attempts to comply with government regulations concerning bilingual 
education are described by Mary Spencer and Maria Ortiz. In "A School 
District's Response to LAU," Ortiz gives an overview of Tucson Unified 
School District's (TUSD) initial efforts to comp 1 y wi th leg i s 1 at i on govern ing 
bilingual education and then describes subsequent efforts to refine those 
efforts. She also gives her point of view with regard to the need for col- 
laborative research and realistic educationa-i policies.* 

She indicates that TUSD ' s initial plan for compliance involved identifir 
cation and placement of several hundred non-native English speaking or 
bilingual students. The tests selected for the identification process were 
the School Language Inventory and the Language Dominance Instrument . The 
students identified as limited English proficient in grades K through 6 
were placed in bj,J/fngual education programs while those in grades 7 through 
12 were place^ in English as a Second Language (ESL) programs. The programs 
for both q^ups tended to be "compensatory" or "remedial." She points out 
that there\vere many problems due to lack of staff training and i f f icu 1 1 ies 
in establishing guidelines and procedures. The subsequent action taken to 
rectify the situation involved revision of questions on registration forms, 




more staff training, formation of a task force for the review of procedures", 
the encouragement of the participation of parents and the refocusing of 
policy in bilingual education toward? the needs of language minority students 
Ortiz concludes by stressing the 'need for collaboration among teachers, 
practi tioners -and policymakers in order to be able to develop more effective 
measures of language proficiency assessment in meeting the needs, of language- 
minority students. 

Mary Spencer , i n . "Language Prof ic iency As seasmen t i n Ca 1 i for n i a : 
Research and Deliberation Toward Better Solutionsy" describes the efforts 
of that state in ^providing for the needs of its language mi nor i ty students. 
In attempting to comply with legal mandates, which address the educational 
needs of language minority studentsj, the California State Department of 
Education found ''that the state of instrumentation for the assessment of 
speaking, comprehending, reading, and writing in English as well as non- 
English languages was pt a very nascent level." For this reason a review 
of instruments was undertaken. Those meeting mi n i ma T 1 i rigu i s t ic and 
psychometric standards were designated for use at the local district level, 
and recommendations for improving the quality of all tests reviewed were 
i ssued . / • C 

Following the first year survey, f our \i ns trumen ts were "provisionally" 
designated for use: LA£ ( Language Assessment Scales ); BINL ( Basic Inventory 
of Natural Language ); LAB ( Language Assessment Battery ); and BSM_ ( Bi 1 Tngua I 
Syntax Measure ) . A mo^e comprehensive review was later conducted of nine- 
teen instruments using as criteria the validity and reliability of the tests. 
Other actions taken by the state were the sponsoring of new' research in 
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language proficiency assessment and the development of assessment procedures 
for-purposes of reclassification of students. 

Edward d'e Avila discusses the role of tests of language proficiency in 
^Language Proficiency: Confusions, Paradoxes, and a Few Admonitions to 
Psychologists, Educators, Linguists and Other Developing Assessment Proce- 
dures for Language Minority Students." De Avila discusses: 

• 'Mow correlation between performance , on currently available 
proficiency tests; 

• relative ability of teachers to make global judgment of oral 
language prof ici.ency; and 

• ^ the ability of proficiency measures to predict school achievement." 

With regard to the first, De Avila cautions that "educa'tors must guard • 
against discarding what's known about language testing simply because test 
scores do not tell them all there's to know about language proficiency." 
In considering teachers' assessment of student's oral proficiency De Avila 
^suggests that it is important to bear in mind that a teacher's linguistic 
background could very much^affect a child's language j3rof iciency evaluation. 
Thus he argues that "teacher judgment data must be subjected to the same 
vigors as any test procedure." With respect to the' issue of the predic.tive 

E 

validity language assessment instruments^ he suggests that "it is more 
important to look at the kinds of proficiencies which contribute to academic 
achievement rather than to look at the plethora of social and linguistic 
^competenci es ' which go to make up the child's general communicative abilities." 

in conclusion, De Avila outlines what he. considers Important in order 
to develop a test which serves the needs of language minority children: 

ERIC 
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First, it is necessary to have a good knowledge of the domains and 
issues relating to language assessment, along with an understanding 
of the relationship between different linguistic dimensions of pro- 
ficiencyand overall competency. ' 

Secondly, it is necessary to maintain an exchange of information and 
ideas among those i nd-iv i dua 1 s involved in the field of language pro- 
ficiency assessment in order that new approaches or methodologies 
can be critiqued and improved 'to more effectively meet the needs of 
language minority students. 

Thirdly, greater funding will be necessary In order to develo'p more 
effective measures of language proficiency. If possible, it should 
not involve the' use of federaN funds sln^e this often means a loss 
of freedom to pursue objectives. 

Fourth and ' lastly , ^courage and determination will be necessary. Language 
proficiency assessment Is an area of education which Is experiencing a 
great deal of reevaluatlon and innovation, and : new ideas and approaches 
may require time to be accepted and tested. A certai n amount of crit- 
icism will have to be^ndured by the designers of new instruments and 
by those suggesting ngw approaches to^ language proficiency asses^ent. 
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bvtmmary of Symposium Themes 



The final session, of the Symposium consisted of a summary of the themes 
of the Symposium from both an anthropological and psycho t i ngu i s t i c perspec- 
tive. 



Muriel Savi 1 le-Troi ke, in "An thropo 1 og i cal -L i ngu i s t ic Perspectives," 

focused on the jssue of communicative competence and the problems involved 

in assessing it. She describes communicative competence as: 

. . a body of knowledge and skills wh ich ■ i nvol ves not only the 
language code that they use, but also what they can say to whom, 
how they should say it appropriately in any given situation, and 
even when they should say nothing at all. It involves interaction 
skills such as knowing how they may develop conversations, and also 
knowing how to avoid becoming involved in a conversation if they 
prefer, to be engaged in some other activity. It involves receptive 
as wel 1 as productive faci Itty , written as wel 1 as oral modes of^ 
communication, and nonverbal as well cis verbal behaviors. Communi- • 
cativ'e competence further involves having appropriate soc i ocu 1 tura 1 
schemata, or the social and cultural knowledge and eXlpec ta t ions 
tha t speakers/hearer s/readers/wri ters are presumed to have which 
enables them to use and interpret communicative forms. The concept 
of communicative competence mu^t thus be embedded in the notion of 
.cultural competence: interpreti ng' the meaning of linguistic be- 
havior; requ i res knowing the cultural meaning of the context within 
wh i ch i t^ occu r s . ' • " . 

She acknowledges the /importance of schoo 1 -re 1 a ted skills in assessing 
children's language abilities. However, since they are only a part of a 
whole system of a child's abilities, she suggests that it is essential to 
gather data on children's language use in other contexts. With regard to 
the methods and instruments used in assessment, Sav i 1 1 e-Tr oi ke advocates 
a naturalistic context for language assessment. 

Testing students for the purpose of placement in appropriate programs 
and for the purpose of. exiting them when they attain sufficient skills in 
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English were a 1 so d i scussed . On this topic, Savi I Je-Troi ke states "if 
there is any question at all on the procedures and instruments that are 
used, districts must move in a more conservative direction. Students 
should be placed in native language support until there I's time for more 
adequate and thorough testing to be sure they can hand le' Eng 1 i sh-on 1 y 
Instruction.'' In the area of language development, she states that stu-» 
dents should be given "the opportunity to learn, in interactive situations, 
how to do what they need to do with language." She concludes by cautioning 
that "fhe present emphasis on testing communicative competence may represent 
a bandwagon phenomenon" which is promising but which must be seen as com- 
plementary to psycholinguistic and psychometric means of assessing language 
proficiency. 

In "Psycholinguistic Aspects," Fred Genesee explains that there has 
been a shift from grammatical competence to issues related to communicative 
competence. He indicates that'^ne significant reason why the theme has 
emerged as important is that "improved methods of language proficiency and 
assessment, particularly those that take communicative competence into 
account, will improve (the) placement of non-Eng 1 i sh speaking or limited 
English speaking students in appropriate educational programs." He examines 
"the assumptions or expectations which unc^erline the relationship that is 
being hypothesized between communicative Competence and academic achievement 
or general school success." The assumptions are that: 

• "the communicative competence of children i n the i r- pr imary 
language" can be characterized; 

• "children who do not possess the requisite communicative 
competence in c 1 ass room 1 anguage usage . . . can be taught 
these competencies; and 
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• "aca'demic achievement in school, js necessary and/o[- sub- 
stantially related to communicative competence and language 
proficiency in general." 

With regard to the first assumption, Genesee indicates that although many 

issuers remain to be resolved before "communicative models of language^ 

proficiency can presently b« applied meaningfully and usefully in bilingual 

education" the theoretical and empirical work d i scussed at the Symposium 

as well as the other research undertaken in monolingual classrooms indicates 

progress. 

Concerning the Assessment of communicative competence, Genesee. states 
that there are three major issues thpt must be dealt with in developing 
tests of communicative competence: 

• "the authenticity or face validity of communicative competence; 

♦ Their representativeness or situational genera 1 I zab i 1 i ty ; 

♦ The definition of proficiency levels." 

On teaching communicative competence, Genesee reports that de-spite the lack 
of a strong theoretical base, "communication-oriented educational programs 
have been found to be relatively successful at least within limits set by 
school settings." Finally, in regard to the relationship between communica- 
tive competence and academic achievement, he bel.ieves that the issue is not 
whether a relationship exists. but, rather, the extent of that relationship. 
He adds that, "greater attention needs to be paid to the potential influence 
of other non-language factors, alone and in interaction with language pro- 
ficiency." 

Genesee concludes by stating that although many "unresolved theoretical 
and psychometric issues" remain., before tests of communicative competence 



can be effectively used in bilingual education programs, i^t is imperative 
to undertake this approach. 

Bernard Spolsky concluded the Symposium by offering a more philosophical 
perspective on the issue of language testing and related topics in "The Uses 
of Language Tests; An Ethical Envoi." Spolsky states that those individuals 
•evolved in language testing have experienced the realization that neither ' 
the ways of the past nor the innovations of more recent history have pro- 
vided satisfactory solutions to the many problems arising out of attempts to 
improve language proficiency assessment. New solutions have brought with 
them other more serious problems. For example, the advantage of the tradi- 

tional system of testing lies in the fact that the process involves direct 

\ 

contact between two human beings; the candidate is seen-^as an individual 
\ rather than a name on a piece of paper. Yet, this approach is based on 

"the assumption that certain people have the authority to make judgments 
about others." The system only v^orks, Spolsky states, "as long as the 
authority of the judges or examiners is not questioned." The modern or 
psychometric-structuralist approach to language testing p 1 aces more emphas is 
1 on the reliability of tests, their objectivity and the degree to which they 

lend themselves to statistical analysis. In this way, it is believed, 
authority is afforded by virtue of the tests* objectivity. However, the 
insistence on objectivity most often results, in a much more dehumanized 
process, in which a child is assessed by a system or a computer rather than 
another human being who can make a more glpbal assessment of his or her 
skills. The last approach which Spolsky examines is what he calls the 

post-modern or psycho 1 i ngu i s ti c-soc i o 1 i ngu i s t i c approach which "grew'out of 

/ 

questions raised by the various disciplines about what it means to know and 
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Co use language*" Rather Chan reducing . language to discrete componencs*, 
Chis approach atCempCs Co 'deal with language in larger, more natural con- 
texCs. IC is an acknowledgemenc of Che fact ChaC none of Che solgci^ons Co 
effeccive language tes C i ng whi ch ^have been'offered in Che past is perfecC, 
ChaC assessing an . individual ' s language skills is a much more complex process 
Chan previously believed. Thus, Spolsky sCaCes "we are ready, ic seems Co 
me, CO live wrth the fact that there is not ever going to be a cheap, quick, 
reliable and valid test of a human be ing ' s. i^nowlgdge of Janguage." 

Therefore, Spolsky Indicates regardless of the approach taken, tHd 
designers and users of tests have three primary responsibilities: 

• to avoid certainty: anyone who claims to have 5 perfect 
test, or to be prepareB to cnake an impor tan t deci s ion 

on the basis of a single test result is acting irresponsibly; 

• to avoid mysticism: avoid hiding behind adthor/ty, technical 
jargon or statistics; and O 

• to make sure that tests, like dangerous drugs, are accurately 
labelled and used wi^th considerable care. 

Suggesting that the issues and 'probl-ems discussed at the Symposium are 

more problems of teaching than problems of testing, SpO I sky^ exp la i ns that, 

"the ideal teacher will go over everything as many times as a student needs, 

and the ideal school system that is seeking to let every pupil develop the 

best of his or her potential will find it comparatively easy to learn all 

it needs to knov/ about that pupil's progress without elaborate test-ing 

methods." Spol sky summar i zed the conclusions and reactions of the partici- 

pants to the issues discussed at the Symposium in this way: 

Most of the participants in the conference, whether researchers or 
practitioners, chafed at the r^estriction to "measurement," at the 
need to sort and classify the 'pupils, and evidenced a healthy and 
hopeful desire to understand more about them* through new methods 
of assessing their proficiency as speakers and listeners and readers 
and writers. In this way, they have made their contribution to 
the movement for responsible, learner-or ient-ed use of language 
tests. Such an approach deserves encouragement and support. 



Summary of Participants Understandings and Recommendations 

The final session provided a structure for participants to comment 
from the perspective of the three representative groups researchers, 
practitioners and policymakers — as to the. extent to which the goals 
of the Symposium were met. They summarized their understandings of 
the various issues which affect language proficiency assessment practices 
and made practical suggestions and recommendations. It was believed 
that each group, because of its unique role in the field, would be able 
to bring different insights into the discussion of the stated goals of 
the LPA Symposium. The following is a report on the conclusions reached 
and the recommendations of each group as a result of their participation in 
the Sympos i um. ' 

Researchers . The researchers indicated that a major issue of concern 
was that of clarifying the construct of communicative competerice and its 
relationship to language proficiency. It was recognized that, at present 
there are multiple interpretations of the construct at both the theoretical 
and applied levels. Views of participants to the LPA Symposium ranged 
from relating communicative competence only to those cognitive and communica- 
tion skills required for school learning, while ignoring soc i ocu I tura 1 1 y- 
related language skills, to the recognition that cogn i t i ve and language 
socialization skills may be manifested in .tu 1 tu ra 1 1 y different ways, aqd 
can serve as a foundation for school learning. In recognition of the 
diversity of perspectives regarding communicative competence, the researchers 
agreed that there is a pressing need for more basic research which can provide 
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the foundation for both clarifying and expanding the concept of communi- 
cative competence and its relationship to language proficiency. ^ 

The researchers emphasized the need for applied research which expands 
on current knowledge of language proficiency. In view of the limited avail- 
ability of valid and appropriate language proficiency instruments, there was 
particular concern that validation studies be undertaken. 

The fact that the range of social and academic uses of language may 
not be evidenced when mu 1 t i 1 i ngua I /mu 1 t i cu 1 tura 1 children are tested 
through traditional methods prompted the researchers to support the develop- 
ment of multiple language assessment strategies. They agreed that such 
strategies should include both qualitative and quantitative components. 
The use of sociol i ngu istic/ethnographic approaches such as teacher observa- 
tions and student self-reports were suggested as variations which should 
t)e seriou-^ly studied. The use of separate yet parallel language proficiency 
measures in both the native (L^) and the second (L^) languages was also 
! strongly supported. i 

The state of the art of language proficiency assessment, the researchers 
concurred, is one of reassessment and new directions. This prompted them 
to advise that any federal guidelines which are established to guide language 
proficiency assessment practices should be adaptable. Adaptability, they 
indicated, is essential in order to allow educators and researchers to con- 
tinueNin their efforts to develop new strategies for the assessment of 
language proficiency through expanded research into the nature of language 
and methods for its measurement. Any federal guidelines which are established 
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Trust, in their opinion, allow for the inclusion of new findings which may 
alter the perspective with regard to language proficiency assessment prac- 
tices. 

In order to share research findings and to coordinate efforts in the 
development more effective language proficiency measures, it was proposed 
that yearly meetings of practitioners and researchers be established. The 
purpose of these meetings would be to focus on issues related to the ongoing 
development of rnean i ngfu 1 and appropriate language proficiency assessment 
strategies enabling those in attendance to Incorporate into their respective 
areas of concern new information and practical field experience. Briefly, 
the primary concerns of the researchers were the following: 

• the need for basic research into the nature of language 
that can provide the foundation for clarifying the concept 
of communicative competence and its relationship to language 
prof iciency; 

• the need for applied research which expands on current under- 
standing of the state of the art of language proficiency 
assessment; 

• the need to undertake validation studies of currently avail- 
able language proficiency assessment instruments; 

' • the development of multiple language assessment strategies 
which include both quanti tat ive and qualitative components; 

• the need fo- adaptable government guidelines which affect 
language prof ic i ency assessment practi ces ; and 

• the need for yearly meetings between researchers and prac- * 
titioners to exchange information and ."ideas, 

Practi ti oners . The need for a working definition o" communicative com- 
petence was seen as central^ to the issue of language proficiency assessment. 
The participants started that there should be at least some agreement among 
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practitioners as to the nature of communicative competence and its relation- 
ship CO language proficiency. They stressed that any attempt to describe 
communicative competence should be broad enough in scope to recognize each 
child's culturally acquired communicative skills and their relationship 
to learning in school settings. Language proficiency tests, they agreed, 
often focus on linguistic aspects of language and ignore other soc i ocu 1 tur a 1 1 y- 
related language skills which a child may possess when he or she enters 
schoo 1 . ^ 

The practi tioners emphasized that federa 1 gu fde 1 i nes affecting language 
proficiency assessment practices and strategies should be practica.1 as well 
as adaptable. They indicated that any federal guidelines which are estab- 
I i shed should allow local school districts the freedom to select alternative 
strategies from among several we 1 1 -researched options in attempting to meet 
the needs of the children served by programs in those districts. Adaptability, 
they stressed, is impor tan t because of the need to provide a means of in-* 
corporating, into government policy, research findings concerning the nature 
of communicative competence and its reality-based implications with regard 
to language proficiency assessment practices. 

The practitioners also emphasized that research should be a collabora- 
tive effort between practitioners c^nd researchers. The development of a 
network of communication among researchers, policymakers and practitioners 
for^ the purpose of identifying issues related to language proficiency which 
need to be researched was strongly supported. Many of the practitioners 
indicated that they feel isolated because they generally are not consulted 
or provided with up-to-date informatioh concerning new developments in the 
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measurement of the language proficiency of language minority students: 
As examples of the kinds of steps which can be taken to make this informa- 
tion more available, the practitioners encouraged more extensive use of 
the National Clearinghouse for Bilingual Education (NCBE) for the collection 
publicaticn, and dissemination of information on language proficiency 
assessment practices. They also supported the development and implementa- 
tion of in-service teacher training programs which focus on language pro- 
ficiency asses'sment issues. In addition, they recommended more frequent 
information exchanges between researchers, practitioners and policymakers. 
The LPA Sympqsium, they indicated, was a model of the type of collaboration 
which should be promoted. 

The practitioners emphasized the need for government agencies such 
as NIE and the Office of Bilingual Education and Minority Language Affairs 
(OB'EMLA), to continue to support and encourage mor e applied collaborative 
research. One sucn method of encouragement which was strongly suggested 
was to include as criteria in Requests for Proposals (RFPs) the participa- 
^tion of practitioners at the local level. 

In short, the major issues identified by th^ practitioners were: 

• the need for a wo r k i ng def i n i t ion of communicative competence 
which clarifies its relationship to language proficiency; 

• the establishment of practical as well as adaptable federal 
guidelines affecting language proficiency assessment practices; 

• the importance of maintaining a network of communication between 
pract i t i oner s and r esea rchers ; 

• the importance of obta in ing up-to-date information on language 
P'-oficiency assessment practices through more extensive use 

of resources such as the National Clearinghouse for Bilingual 
Education (NC3E); 
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• the use of the LPA Symposium as a model for future meetings 
among practi ti oners, researchers and pol icymakers i nvolved 
in language proficiency assessment practices which affect 
language minority students; and 

• the support of federal agencies in encouraging collaboration 
between researchers and practitioners in applied research 
efforts. 

Pol icymaker s . The par t ici pants in this group acknowledged the need for 
adaptable federal guidelines that would provide a structure on which to 
base, the development of procedures for language proficiency assessment 
practices. Adaptability, they agreed, is essential in order to support, 
practt ttoners and researchers tn thetr efforts tac^arrfyt 

• what IS meant by language; and 

• how it should be measured. 

Thus, the policymakers were in support of federal guidelines which allow 
for the incorporation of relevant research findings that may change the 
practical application of language proficiency assessment practices. 

The policymakers recognized the need for federal agenc i es' such as NIE 
and OBEMLA to continue to promote applied research which explores the 
nature of language. Research findings, they agreed, should provide the 
basis for developing more appropriate and effective methods for assessing 
the language proficiency of language minority students. In addition, they 
agreed' that research should be a collaborative effort between practitioners 
and researchers . 

In summary, the issues of most importance, as seen by the policymakers, 

v/ere: 

• the need to establish federal guidelines which can be adapted 
to acconimodate relevant research findings that have bearing 
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on Che practical application of language proficiency assess- 
ment practices; 

• the need for federal agencies to continue to support applied 
research on issues related to language proficiency assessment 
through grants and other forms of funding; and . 

• the need for federal agencies to support research which is 
carried out as a joint venture on the part of researchers 
and prac t i ti oners . 



In conclusion, participants at the Symposium represented a wide range 
of perspectives with regard to theoretical and practical applicatrons ©f 
research in the area of language proficiency assessment. The major issue 
of defining the concept of communicative competence and its relationship 
to language proficiency proved to be difficult because of the d ivers i ty of 
viewpoints, theories and research findings concerning the nature of language 
It was evident that some agreement among researchers and practitioners along 
with much more conclusive information about the nature of language and how 
It should be measured would be necessary to clarify the concept of ccmmunf- 
cative competence and its relationship to language proficiency assessment. 

The participants recognized the limitations of cur ren 1 1 y-ava i I ab I-e 
me'asures of language proficiency. They c^curred that traditional methods 
of testing language proficiency were both u>nreliable and limited in scope 
with regard to the types of skills they asse^Vand in their failure to 
recognize the culturally-related skills that min<y/jty language students 
possess. r 

A general disenchantment with traditional measures prompted researchers 
and practitioners to recommend the implementation of validation studies of 
currently-used measures. In view of this dissatisfaction, participants 
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also endorsed the further exploration of alternative modes of testing 
communicative competence/ language proficiency including the development 
of Innovative approaches such a-s the sociol ingui s tic/ethnographic perspec- 
tive- 

in order to be able to work effective) y toward the resolution of major 
issues addressed at the Symposium, the participants recommended the coord ina- 
tion of efforts between researchers and practitioners through the estab-^ 
llshment of a network of communication and information exchanges. Yearly 
meetings, the publication and dissemination of new findings (journals, news- 
letters,, etc) , ..and _t.eacher-training-_prog4^ms-^w^^ of ^the -me-t+K3d^— recom— 
mended for maintaining a network of cooperation. 
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Publication Dissemination Plan for the LPA Symposium Proceedings 



The plan for the LPA Symposium proceedings is to publish them in 
the form of four monographs through the Center for Applied Linguistics 
(CAL) . Papers from the Symposium have undergone editing apd have been 
organized according to major issues addressed at the Symposium. In 
Appendix: I 1 I^A is found a listing of the monographs and their contents. 

Because of the nature of the monographs, CAL was selected as the pub- 
lisher. CAL is an organization which has a long history of successful pub^ 
lications for linguists, ESL teachers , teacher trainers, and vb i 1 i ngua 1 re- 
searchers and educators. 

; The agreement which has been reached with CAL is that the four mono- 

graphs will be published on or before June 30, 1982. Volumes will be pub- 
lished as both hard and paperback 6X9 books, tn the first printing, 2,000 
copies of each volume will be published, 200-500 in hardback and the rest 
in paperback. The monographs will be cross referenced with CAL's: 

V 

I o Testing Series; 

J o the Bilingual Education Series; and 

o the Language and Ethnography Series; 

in their catalogue of publications which is currently disseminated to 70,000 

individuals, institutions and libraries. Quarterly, mailings of their new 
i ^ publications, including the monographs will be sent out to targeted audiences 

In addition, they plan to send exhibits which will include the monographs 

to some 22 conventions and meetings in 1982 and 1983. 
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